Nov 05 17:29:34 devstack cinder-volume[76073]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 17:29:34 devstack cinder-volume[76073]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 17:29:34 devstack cinder-volume[76073]: we strongly recommend against using it for new projects. Nov 05 17:29:34 devstack cinder-volume[76073]: If you are already using Eventlet, we recommend migrating to a different Nov 05 17:29:34 devstack cinder-volume[76073]: framework. For more detail see Nov 05 17:29:34 devstack cinder-volume[76073]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 17:29:34 devstack cinder-volume[76073]: import eventlet # noqa Nov 05 17:29:37 devstack cinder-volume[76073]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76073) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 17:29:37 devstack cinder-volume[76073]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76073) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 17:29:37 devstack cinder-volume[76073]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76073) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 17:29:38 devstack cinder-volume[76073]: INFO dbcounter [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Registered counter for database cinder Nov 05 17:29:38 devstack cinder-volume[76073]: DEBUG oslo_db.sqlalchemy.engines [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76073) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:29:38 devstack cinder-volume[76073]: DEBUG dbcounter [-] [76073] Writer thread running {{(pid=76073) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 17:29:38 devstack cinder-volume[76073]: INFO cinder.rpc [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 17:29:38 devstack cinder-volume[76073]: INFO cinder.rpc [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 17:29:38 devstack cinder-volume[76073]: DEBUG oslo_db.sqlalchemy.engines [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76073) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:29:38 devstack cinder-volume[76073]: INFO cinder.volume.manager [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Determined volume DB was empty at startup. Nov 05 17:29:38 devstack cinder-volume[76073]: DEBUG cinder.volume.manager [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76073) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 17:29:38 devstack cinder-volume[76073]: INFO cinder.volume.manager [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 17:29:38 devstack cinder-volume[76073]: WARNING stevedore.named [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 17:29:38 devstack cinder-volume[76073]: WARNING castellan.key_manager [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 17:29:38 devstack cinder-volume[76073]: WARNING cinder.keymgr.conf_key_mgr [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 17:29:38 devstack cinder-volume[76073]: DEBUG cinder.volume.drivers.lvm [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76073) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 17:29:38 devstack cinder-volume[76073]: DEBUG oslo_concurrency.processutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76073) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_concurrency.processutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] CMD "cinder-rtstool verify" returned: 0 in 0.410s {{(pid=76073) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_db.sqlalchemy.engines [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76073) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:29:39 devstack cinder-volume[76073]: INFO cinder.rpc [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 17:29:39 devstack cinder-volume[76073]: INFO cinder.rpc [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 17:29:39 devstack cinder-volume[76073]: WARNING stevedore.named [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 17:29:39 devstack cinder-volume[76073]: WARNING castellan.key_manager [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 17:29:39 devstack cinder-volume[76073]: INFO cinder.volume.manager [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_db.sqlalchemy.engines [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76073) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:29:39 devstack cinder-volume[76073]: INFO oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Starting 1 workers Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Started child 76232 {{(pid=76073) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Full set of CONF: {{(pid=76073) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] ******************************************************************************** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Configuration options gathered from: {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] ================================================================================ {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] allow_availability_zone_fallback = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] allow_compression_on_image_upload = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] allowed_direct_url_schemes = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] api_rate_limit = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] auth_strategy = keystone {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] az_cache_duration = 3600 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_availability_zone = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_host = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_stats_polling_interval = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backup_api_class = cinder.backup.api.API {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backup_name_template = backup-%s {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backup_use_same_host = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76232]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backup_use_temp_snapshot = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] chap_password = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] chap_username = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_internal_tenant_project_id = e11f3d3f51b744869316bc1c20566dda {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_internal_tenant_user_id = e8267fb348e04490b75d79a4245861cc {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cloned_volume_same_az = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cluster = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] compression_format = gzip {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] compute_api_class = cinder.compute.nova.API {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] config_dir = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] config_source = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] control_exchange = openstack {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] debug = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] default_availability_zone = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] default_group_type = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] default_volume_type = lvmdriver-1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] disk_geometry = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] driver_client_cert = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] driver_client_cert_key = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] driver_data_namespace = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] driver_ssl_cert_path = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] driver_ssl_cert_verify = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] driver_use_ssl = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] enable_force_upload = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] enable_new_services = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] enable_unsupported_driver = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] enforce_multipath_for_image_xfer = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] filter_function = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_api_insecure = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_api_servers = ['http://192.168.122.242/image'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_api_ssl_compression = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_ca_certificates_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_catalog_info = image:glance:publicURL {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_num_retries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance_request_timeout = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] goodness_function = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] graceful_shutdown_timeout = 5 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] group_api_class = cinder.group.api.API {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] host = devstack {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_compress_on_upload = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_conversion_address_space_limit = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_conversion_cpu_limit = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_conversion_disable = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_introspection_address_space_limit = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_introspection_cpu_limit = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_upload_use_cinder_backend = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_upload_use_internal_tenant = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_volume_cache_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_volume_cache_max_count = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] image_volume_cache_max_size_gb = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] init_host_max_objects_retrieval = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] instance_format = [instance: %(uuid)s] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] iscsi_target_flags = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] iscsi_write_cache = on {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] iser_helper = tgtadm {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] iser_ip_address = 192.168.122.242 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] iser_port = 3260 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_color = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_config_append = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_dir = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_options = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_rotate_interval = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_rotate_interval_type = days {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] log_rotation_type = none {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] max_age = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] max_logfile_count = 30 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] max_logfile_size_mb = 200 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] max_over_subscription_ratio = 20.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] message_reap_interval = 86400 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] message_ttl = 2592000 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] migration_create_volume_timeout_secs = 300 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] monkey_patch = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] monkey_patch_modules = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] my_ip = 192.168.122.242 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] no_snapshot_gb_quota = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] num_iser_scan_tries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] num_shell_tries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] num_volume_device_scan_tries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] nvmeof_conn_info_version = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] nvmet_ns_id = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] nvmet_port_id = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] osapi_max_limit = 1000 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] osapi_volume_ext_list = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] osapi_volume_listen_port = 8776 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] osapi_volume_use_ssl = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] osapi_volume_workers = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] per_volume_size_limit = -1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] periodic_fuzzy_delay = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] periodic_interval = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] public_endpoint = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] publish_errors = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] quota_backup_gigabytes = 1000 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] quota_backups = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] quota_gigabytes = 1000 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] quota_groups = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] quota_snapshots = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] quota_volumes = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] rate_limit_burst = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] rate_limit_except_level = CRITICAL {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] rate_limit_interval = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] reinit_driver_count = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] replication_device = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] report_discard_supported = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] report_interval = 120 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] reservation_clean_interval = 86400 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] reservation_expire = 86400 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] reserved_image_namespaces = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] reserved_percentage = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] rpc_response_timeout = 120 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] run_external_periodic_tasks = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] scst_target_driver = iscsi {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] scst_target_iqn_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_down_time = 720 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] shell_completion = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] snapshot_name_template = snapshot-%s {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] snapshot_same_host = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] split_loggers = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] state_path = /opt/stack/data/cinder {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] storage_availability_zone = nova {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] storage_protocol = iSCSI {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] syslog_log_facility = LOG_USER {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] target_helper = lioadm {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] target_ip_address = 192.168.122.242 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] target_port = 3260 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] target_protocol = iscsi {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] target_secondary_ip_addresses = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] trace_flags = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] transport_url = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] until_refresh = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] use_chap_auth = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] use_default_quota_class = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] use_journal = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] use_json = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] use_multipath_for_image_xfer = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] use_stderr = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] use_syslog = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] verify_glance_signatures = enabled {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_api_class = cinder.volume.api.API {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_backend_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_clear = zero {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_clear_ionice = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_clear_size = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_copy_bps_limit = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_dd_blocksize = 1M {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_name_template = volume-%s {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_service_inithost_offload = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volume_usage_audit_period = month {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] zoning_mode = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_concurrency.disable_process_locking = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.auth_section = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.auth_type = password {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.auth_version = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.cache = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.include_service_catalog = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.insecure = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.interface = public {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_password = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcache_username = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.region_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.service_type = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.backend = dogpile.cache.null {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.backend_argument = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.backend_expiration_time = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.config_prefix = cache.oslo {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.debug_cache_backend = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.enable_retry_client = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.enable_socket_keepalive = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.expiration_time = 600 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.hashclient_retry_attempts = 2 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.memcache_dead_retry = 300 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.memcache_pool_maxsize = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.memcache_sasl_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.password = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.proxies = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.redis_db = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.redis_server = localhost:6379 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.retry_attempts = 2 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.retry_delay = 0.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.socket_keepalive_count = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.socket_keepalive_idle = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.socket_keepalive_interval = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.socket_timeout = 1.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.tls_allowed_ciphers = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.tls_cafile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.tls_certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.tls_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.tls_keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cache.username = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] coordination.backend_url = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.asyncio_connection = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.asyncio_slave_connection = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.backend = sqlalchemy {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.connection = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.connection_debug = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.connection_parameters = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.connection_recycle_time = 3600 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.connection_trace = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.db_inc_retry_interval = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.db_max_retries = 20 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.db_max_retry_interval = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.db_retry_interval = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.max_overflow = 50 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.max_pool_size = 5 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.max_retries = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.mysql_wsrep_sync_wait = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.pool_timeout = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.retry_interval = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.slave_connection = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.sqlite_synchronous = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.synchronous_reader = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] database.use_db_reconnect = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_tracing.insecure = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.connection_string = messaging:// {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.es_doc_type = notification {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.es_scroll_size = 10000 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.es_scroll_time = 2m {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.filter_error_trace = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.hmac_keys = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.sentinel_service_name = mymaster {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.socket_timeout = 0.1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.trace_requests = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler.trace_sqlalchemy = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler_jaeger.process_tags = {} {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler_jaeger.service_name_prefix = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] profiler_otlp.service_name_prefix = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.enforce_new_defaults = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.policy_default_rule = default {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.policy_file = policy.yaml {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] privsep_osbrick.group = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] privsep_osbrick.helper_command = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] privsep_osbrick.user = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_sys_admin.group = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_sys_admin.helper_command = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] cinder_sys_admin.user = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.auth_section = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.auth_type = password {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.cafile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.collect_timing = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.insecure = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.send_service_user_token = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.split_loggers = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.timeout = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.tls_ciphers = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] service_user.tls_min_version = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.auth_section = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.auth_type = password {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.collect_timing = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.insecure = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.region_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.split_loggers = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.timeout = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.tls_ciphers = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] glance.tls_min_version = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.backend_availability_zone = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.chap_password = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.chap_username = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.disk_geometry = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.driver_client_cert = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.driver_client_cert_key = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.driver_data_namespace = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.driver_use_ssl = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.extra_capabilities = {} {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.filter_function = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.goodness_function = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.iscsi_target_flags = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.iscsi_write_cache = on {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.iser_helper = tgtadm {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.iser_port = 3260 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.lvm_share_target = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.lvm_type = auto {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.num_shell_tries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.replication_device = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.report_discard_supported = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.reserved_percentage = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.target_helper = tgtadm {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.target_port = 3260 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.target_protocol = iscsi {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.trace_flags = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.unique_fqdn_network = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.use_chap_auth = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_backend_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_clear = zero {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_clear_ionice = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_clear_size = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_reports.file_event_handler = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack sudo[76236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 17:29:39 devstack sudo[76236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_reports.log_dir = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.backend_host = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.chap_password = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.chap_username = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.disk_geometry = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.driver_client_cert = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.extra_capabilities = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.filter_function = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.goodness_function = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.iser_helper = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.iser_ip_address = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.iser_port = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.lvm_share_target = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.lvm_type = auto {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.num_shell_tries = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.replication_device = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.report_discard_supported = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.reserved_percentage = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.scst_target_driver = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.storage_protocol = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.target_helper = lioadm {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.target_ip_address = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.target_port = 3260 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.trace_flags = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.use_chap_auth = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_clear = zero {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_clear_size = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] lvmdriver-1.volumes_dir = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.ssl = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_notifications.driver = [] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_notifications.retry = -1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] key_manager.fixed_key = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.barbican_api_version = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.barbican_endpoint = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.barbican_endpoint_type = public {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.barbican_region_name = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.cafile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.collect_timing = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.insecure = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.number_of_retries = 60 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.retry_delay = 1 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.send_service_user_token = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.split_loggers = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.timeout = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.tls_ciphers = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.tls_min_version = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.verify_ssl = True {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican.verify_ssl_path = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.auth_section = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.auth_type = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.cafile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.certfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.collect_timing = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.insecure = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.keyfile = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.split_loggers = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.timeout = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.tls_ciphers = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] barbican_service_user.tls_min_version = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.approle_role_id = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.approle_secret_id = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.auth_method = approle {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.auth_path = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.kv_mountpoint = secret {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.kv_path = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.kv_version = 2 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.namespace = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.root_token_id = **** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.ssl_ca_crt_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.timeout = 60.0 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.token_file = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.token_role = None {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.use_ssl = False {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:29:39 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] ******************************************************************************** {{(pid=76073) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 17:29:39 devstack sudo[76236]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:39 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:39 devstack sudo[76243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:39 devstack sudo[76243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:40 devstack sudo[76243]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.357s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:29:40 devstack cinder-volume[76232]: INFO cinder.brick.local_dev.lvm [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:40 devstack sudo[76248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:29:40 devstack sudo[76248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:40 devstack sudo[76248]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG cinder.brick.local_dev.lvm [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76232) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:40 devstack sudo[76335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:40 devstack sudo[76335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:40 devstack sudo[76335]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:40 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:41 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:41 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:41 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:41 devstack sudo[76625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 17:29:41 devstack sudo[76625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:41 devstack sudo[76625]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.253s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:41 devstack sudo[76707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:29:41 devstack sudo[76707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:41 devstack sudo[76707]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:41 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:41 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:29:41 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:42 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:42 devstack sudo[76858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:29:42 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:42 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:42 devstack sudo[76866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:42 devstack sudo[76866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:42 devstack sudo[76866]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.338s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:42 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:42 devstack sudo[76947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:42 devstack sudo[76947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:43 devstack sudo[76947]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:43 devstack cinder-volume[76232]: INFO cinder.volume.drivers.lvm [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:43 devstack sudo[76957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:43 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:43 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:43 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:29:43 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:43 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:43 devstack sudo[77050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:29:43 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:43 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:43 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:43 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:43 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:44 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:44 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:29:44 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:44 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:44 devstack cinder-volume[76232]: INFO cinder.volume.driver [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Driver hasn't implemented _init_vendor_properties() Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG cinder.volume.driver [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76232) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG oslo_db.sqlalchemy.engines [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writer thread running {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG cinder.db.api [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Building query based on filter {{(pid=76232) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG cinder.image.image_utils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76232) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 17:29:44 devstack cinder-volume[76232]: INFO cinder.keymgr.migration [None req-4f6636bb-69c5-466c-ae88-520ac00f7939 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:44 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:29:44 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:44 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:44 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:29:44 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:45 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:45 devstack sudo[77066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:45 devstack sudo[77066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:45 devstack sudo[77066]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:45 devstack sudo[77070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:29:45 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:45 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:29:45 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Driver initialization completed successfully. Nov 05 17:29:45 devstack cinder-volume[76232]: INFO cinder.manager [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Initiating service 2 cleanup Nov 05 17:29:45 devstack cinder-volume[76232]: INFO cinder.manager [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Service 2 cleanup completed. Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG cinder.service [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Creating RPC server for service cinder-volume {{(pid=76232) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG cinder.service [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76232) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 17:29:45 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 17:29:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:45 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:29:45 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:46 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:46 devstack sudo[77078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:29:46 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:46 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:46 devstack sudo[77081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:29:46 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:46 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:29:46 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:29:46 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:29:46 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Nov 05 17:29:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:29:46 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-81f24c7d-a858-4b3e-b91a-cba4567be0aa None None] Driver post RPC initialization completed successfully. Nov 05 17:29:49 devstack cinder-volume[76073]: DEBUG dbcounter [-] [76073] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76073) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:29:56 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:29:56 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:30:44 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:30:44 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 17:30:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:30:44 devstack sudo[79032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:30:44 devstack sudo[79032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:30:45 devstack sudo[79032]: pam_unix(sudo:session): session closed for user root Nov 05 17:30:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:30:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:30:45 devstack sudo[79035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:30:45 devstack sudo[79035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:30:45 devstack sudo[79035]: pam_unix(sudo:session): session closed for user root Nov 05 17:30:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:30:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:30:45 devstack sudo[79038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:30:45 devstack sudo[79038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:30:45 devstack sudo[79038]: pam_unix(sudo:session): session closed for user root Nov 05 17:30:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:30:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:30:45 devstack sudo[79041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:30:45 devstack sudo[79041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:30:46 devstack sudo[79041]: pam_unix(sudo:session): session closed for user root Nov 05 17:30:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:30:46 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:30:46 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running periodic task VolumeManager._thread_info {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:30:46 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] thread count: 6 {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:30:46 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] thread info: [<_MainThread(MainThread, started 125657701863552)>, , , , , ] {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:31:44 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:31:44 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 17:31:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:31:44 devstack sudo[82379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:31:44 devstack sudo[82379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:31:45 devstack sudo[82379]: pam_unix(sudo:session): session closed for user root Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:31:45 devstack sudo[82382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:31:45 devstack sudo[82382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:31:45 devstack sudo[82382]: pam_unix(sudo:session): session closed for user root Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:31:45 devstack sudo[82402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:31:45 devstack sudo[82402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:31:45 devstack sudo[82402]: pam_unix(sudo:session): session closed for user root Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:31:45 devstack sudo[82405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:31:45 devstack sudo[82405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:31:45 devstack sudo[82405]: pam_unix(sudo:session): session closed for user root Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:31:45 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:31:56 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:31:56 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:UPDATE=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:32:44 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:32:44 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 17:32:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:32:44 devstack sudo[84519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:32:44 devstack sudo[84519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:32:45 devstack sudo[84519]: pam_unix(sudo:session): session closed for user root Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:32:45 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:32:45 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:32:45 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:32:45 devstack sudo[84534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:32:45 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:32:45 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:32:45 devstack sudo[84537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:32:45 devstack sudo[84537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:32:45 devstack sudo[84537]: pam_unix(sudo:session): session closed for user root Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:32:45 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:32:46 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running periodic task VolumeManager._thread_info {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:32:46 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] thread count: 6 {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:32:46 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] thread info: [<_MainThread(MainThread, started 125657701863552)>, , , , , ] {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:33:44 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:33:44 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 17:33:44 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:33:45 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 17:33:45 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:33:45 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Nov 05 17:33:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:33:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:33:45 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:33:45 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:33:45 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Nov 05 17:33:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:33:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:33:45 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 17:33:45 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:33:45 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Nov 05 17:33:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:33:45 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:33:45 devstack sudo[85780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 17:33:45 devstack sudo[85780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:33:46 devstack sudo[85780]: pam_unix(sudo:session): session closed for user root Nov 05 17:33:46 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:33:46 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:33:46 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] Running periodic task VolumeManager._thread_info {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:33:46 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] thread count: 6 {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:33:46 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-5b0b7b3c-2562-43b7-af63-0f85de850ca1 None None] thread info: [<_MainThread(MainThread, started 125657701863552)>, , , , , ] {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:33:56 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:34:03 devstack cinder-volume[76073]: INFO oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Caught SIGTERM, stopping children Nov 05 17:34:03 devstack cinder-volume[76073]: DEBUG oslo_concurrency.lockutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Acquiring lock "singleton_lock" {{(pid=76073) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 17:34:03 devstack cinder-volume[76073]: DEBUG oslo_concurrency.lockutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Acquired lock "singleton_lock" {{(pid=76073) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 17:34:03 devstack cinder-volume[76073]: DEBUG oslo_concurrency.lockutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Releasing lock "singleton_lock" {{(pid=76073) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 17:34:03 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Stop services. {{(pid=76073) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 17:34:03 devstack cinder-volume[76073]: DEBUG oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Killing children. {{(pid=76073) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 17:34:03 devstack cinder-volume[76073]: INFO oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Waiting on 1 children to exit Nov 05 17:34:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.lockutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Acquiring lock "singleton_lock" {{(pid=76232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 17:34:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.lockutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Acquired lock "singleton_lock" {{(pid=76232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 17:34:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.lockutils [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Releasing lock "singleton_lock" {{(pid=76232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 17:34:05 devstack cinder-volume[76232]: WARNING amqp [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 17:34:05 devstack cinder-volume[76232]: WARNING amqp [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 17:34:05 devstack cinder-volume[76073]: INFO oslo_service.backend._eventlet.service [None req-87902cbc-7e7d-4254-bd3c-c01b44b3fa7b None None] Child 76232 exited with status 0 Nov 05 17:34:06 devstack cinder-volume[86269]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 17:34:06 devstack cinder-volume[86269]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 17:34:06 devstack cinder-volume[86269]: we strongly recommend against using it for new projects. Nov 05 17:34:06 devstack cinder-volume[86269]: If you are already using Eventlet, we recommend migrating to a different Nov 05 17:34:06 devstack cinder-volume[86269]: framework. For more detail see Nov 05 17:34:06 devstack cinder-volume[86269]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 17:34:06 devstack cinder-volume[86269]: import eventlet # noqa Nov 05 17:34:08 devstack cinder-volume[86269]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 17:34:08 devstack cinder-volume[86269]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 17:34:08 devstack cinder-volume[86269]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 17:34:08 devstack cinder-volume[86269]: INFO dbcounter [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Registered counter for database cinder Nov 05 17:34:08 devstack cinder-volume[86269]: DEBUG oslo_db.sqlalchemy.engines [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86269) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG dbcounter [-] [86269] Writer thread running {{(pid=86269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 17:34:09 devstack cinder-volume[86269]: INFO cinder.rpc [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 17:34:09 devstack cinder-volume[86269]: INFO cinder.rpc [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_db.sqlalchemy.engines [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86269) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:09 devstack cinder-volume[86269]: INFO cinder.volume.manager [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Determined volume DB was empty at startup. Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG cinder.volume.manager [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86269) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 17:34:09 devstack cinder-volume[86269]: INFO cinder.volume.manager [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 17:34:09 devstack cinder-volume[86269]: WARNING stevedore.named [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 17:34:09 devstack cinder-volume[86269]: WARNING castellan.key_manager [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 17:34:09 devstack cinder-volume[86269]: WARNING cinder.keymgr.conf_key_mgr [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 17:34:09 devstack cinder-volume[86269]: INFO cinder.volume.manager [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_db.sqlalchemy.engines [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86269) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:09 devstack cinder-volume[86269]: INFO oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Starting 1 workers Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Started child 86486 {{(pid=86269) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Full set of CONF: {{(pid=86269) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] ******************************************************************************** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Configuration options gathered from: {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] ================================================================================ {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] allow_availability_zone_fallback = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] allow_compression_on_image_upload = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] allowed_direct_url_schemes = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86486]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] api_rate_limit = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] auth_strategy = keystone {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_availability_zone = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_host = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_stats_polling_interval = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backup_api_class = cinder.backup.api.API {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backup_name_template = backup-%s {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backup_use_same_host = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backup_use_temp_snapshot = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] chap_password = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] chap_username = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_internal_tenant_project_id = e11f3d3f51b744869316bc1c20566dda {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_internal_tenant_user_id = e8267fb348e04490b75d79a4245861cc {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cluster = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] compression_format = gzip {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] compute_api_class = cinder.compute.nova.API {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] config_dir = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] config_source = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] control_exchange = openstack {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] debug = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] default_availability_zone = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] default_group_type = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] default_volume_type = QuobyteHD {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] disk_geometry = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] driver_client_cert = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] driver_client_cert_key = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] driver_data_namespace = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] driver_ssl_cert_path = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] driver_ssl_cert_verify = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] driver_use_ssl = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] enable_new_services = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] enable_unsupported_driver = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] enabled_backends = ['QuobyteHD'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] enforce_multipath_for_image_xfer = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] filter_function = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_api_insecure = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_api_servers = ['http://192.168.122.242/image'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_api_ssl_compression = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_ca_certificates_file = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_catalog_info = image:glance:publicURL {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_num_retries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance_request_timeout = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] goodness_function = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] graceful_shutdown_timeout = 5 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] group_api_class = cinder.group.api.API {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] host = devstack {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_compress_on_upload = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_conversion_address_space_limit = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_conversion_cpu_limit = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_conversion_disable = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_introspection_address_space_limit = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_introspection_cpu_limit = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_upload_use_cinder_backend = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_upload_use_internal_tenant = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_volume_cache_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_volume_cache_max_count = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] image_volume_cache_max_size_gb = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] init_host_max_objects_retrieval = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] instance_format = [instance: %(uuid)s] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] iscsi_target_flags = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] iscsi_write_cache = on {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] iser_helper = tgtadm {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] iser_ip_address = 192.168.122.242 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] iser_port = 3260 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_color = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_config_append = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_dir = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_file = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_options = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_rotate_interval = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_rotate_interval_type = days {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] log_rotation_type = none {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] max_age = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] max_logfile_count = 30 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] max_logfile_size_mb = 200 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] max_over_subscription_ratio = 20.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] message_reap_interval = 86400 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.remotefs [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86486) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] message_ttl = 2592000 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] migration_create_volume_timeout_secs = 300 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] monkey_patch = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] monkey_patch_modules = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] my_ip = 192.168.122.242 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] no_snapshot_gb_quota = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] num_iser_scan_tries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] num_shell_tries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] num_volume_device_scan_tries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] nvmeof_conn_info_version = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] nvmet_ns_id = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] nvmet_port_id = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] osapi_max_limit = 1000 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] osapi_volume_ext_list = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] osapi_volume_listen_port = 8776 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] osapi_volume_use_ssl = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] osapi_volume_workers = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] per_volume_size_limit = -1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] periodic_fuzzy_delay = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] periodic_interval = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] public_endpoint = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] publish_errors = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] quota_backup_gigabytes = 1000 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] quota_backups = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] quota_gigabytes = 1000 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] quota_groups = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] quota_snapshots = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] quota_volumes = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] rate_limit_burst = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] rate_limit_except_level = CRITICAL {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] rate_limit_interval = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] reinit_driver_count = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] replication_device = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] report_discard_supported = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] report_interval = 120 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] reservation_clean_interval = 86400 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] reservation_expire = 86400 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] reserved_image_namespaces = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] reserved_percentage = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] rpc_response_timeout = 120 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] run_external_periodic_tasks = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] scst_target_driver = iscsi {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] scst_target_iqn_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_down_time = 720 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] shell_completion = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] snapshot_name_template = snapshot-%s {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] split_loggers = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] state_path = /opt/stack/data/cinder {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] storage_availability_zone = nova {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] storage_protocol = iSCSI {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] syslog_log_facility = LOG_USER {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] target_helper = lioadm {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] target_ip_address = 192.168.122.242 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] target_port = 3260 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] target_protocol = iscsi {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] target_secondary_ip_addresses = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] trace_flags = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] transport_url = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] until_refresh = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] use_chap_auth = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] use_default_quota_class = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] use_journal = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] use_json = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] use_multipath_for_image_xfer = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] use_stderr = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] use_syslog = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] verify_glance_signatures = enabled {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_api_class = cinder.volume.api.API {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_backend_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_clear = zero {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_clear_ionice = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_clear_size = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_copy_bps_limit = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_dd_blocksize = 1M {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_name_template = volume-%s {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_service_inithost_offload = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volume_usage_audit_period = month {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] zoning_mode = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_concurrency.disable_process_locking = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.auth_section = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.auth_type = password {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.auth_version = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.cache = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.include_service_catalog = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.insecure = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.interface = public {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_password = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86486) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 17:34:09 devstack cinder-volume[86486]: WARNING cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 17:34:09 devstack cinder-volume[86486]: WARNING cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Running cmd (subprocess): mount.quobyte {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcache_username = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.region_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.service_type = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.backend = dogpile.cache.null {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.backend_argument = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.backend_expiration_time = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.config_prefix = cache.oslo {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.debug_cache_backend = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.enable_retry_client = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.enable_socket_keepalive = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.expiration_time = 600 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.hashclient_retry_attempts = 2 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.memcache_dead_retry = 300 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.memcache_pool_maxsize = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.memcache_sasl_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.password = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.proxies = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.redis_db = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.redis_server = localhost:6379 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.retry_attempts = 2 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.retry_delay = 0.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.socket_keepalive_count = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.socket_keepalive_idle = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.socket_keepalive_interval = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.socket_timeout = 1.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.tls_allowed_ciphers = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.tls_cafile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.tls_certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.tls_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.tls_keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cache.username = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] coordination.backend_url = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.asyncio_connection = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.asyncio_slave_connection = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.backend = sqlalchemy {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.connection = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.connection_debug = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.connection_parameters = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.connection_recycle_time = 3600 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.connection_trace = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.db_inc_retry_interval = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.db_max_retries = 20 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.db_max_retry_interval = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.db_retry_interval = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.max_overflow = 50 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.max_pool_size = 5 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.max_retries = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.mysql_wsrep_sync_wait = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.pool_timeout = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.retry_interval = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.slave_connection = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.sqlite_synchronous = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.synchronous_reader = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] database.use_db_reconnect = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_tracing.insecure = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.connection_string = messaging:// {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.es_doc_type = notification {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.es_scroll_size = 10000 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.es_scroll_time = 2m {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.filter_error_trace = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.hmac_keys = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.sentinel_service_name = mymaster {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.socket_timeout = 0.1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.trace_requests = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler.trace_sqlalchemy = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler_jaeger.process_tags = {} {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler_jaeger.service_name_prefix = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] profiler_otlp.service_name_prefix = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.enforce_new_defaults = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.policy_default_rule = default {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.policy_file = policy.yaml {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] privsep_osbrick.group = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] privsep_osbrick.helper_command = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] privsep_osbrick.user = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_sys_admin.group = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_sys_admin.helper_command = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] cinder_sys_admin.user = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.auth_section = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.auth_type = password {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.cafile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.collect_timing = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.insecure = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.send_service_user_token = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.split_loggers = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.timeout = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.tls_ciphers = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] service_user.tls_min_version = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.auth_section = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.auth_type = password {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.collect_timing = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.insecure = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.region_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.split_loggers = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.timeout = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.tls_ciphers = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] glance.tls_min_version = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.backend_availability_zone = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.chap_password = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.chap_username = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.disk_geometry = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.driver_client_cert = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.driver_client_cert_key = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.driver_data_namespace = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.driver_use_ssl = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.extra_capabilities = {} {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.filter_function = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.goodness_function = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.iscsi_target_flags = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.iscsi_write_cache = on {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.iser_helper = tgtadm {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.iser_port = 3260 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_host = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_login = admin {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_mount_options = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_password = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_private_key = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_share_path = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.num_shell_tries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.quobyte_volume_url = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.replication_device = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.report_discard_supported = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.reserved_percentage = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.target_helper = tgtadm {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.target_port = 3260 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.target_protocol = iscsi {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.trace_flags = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.unique_fqdn_network = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.use_chap_auth = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_backend_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_clear = zero {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_clear_ionice = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_clear_size = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_reports.file_event_handler = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_reports.log_dir = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.backend_availability_zone = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.backend_host = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.chap_password = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.chap_username = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.chiscsi_conf = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.disk_geometry = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.driver_client_cert = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.driver_data_namespace = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.driver_use_ssl = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.extra_capabilities = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.filter_function = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.goodness_function = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.iser_helper = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.iser_ip_address = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.iser_port = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.iser_target_prefix = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_host = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_login = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_mount_options = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_password = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_private_key = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_share_path = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_ssh_port = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.num_shell_tries = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.nvmet_port_id = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.replication_device = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.report_discard_supported = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.reserved_percentage = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.scst_target_driver = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.storage_protocol = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.target_helper = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.target_ip_address = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.target_port = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.target_prefix = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.target_protocol = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.trace_flags = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.use_chap_auth = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_clear = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_clear_size = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] QuobyteHD.volumes_dir = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.ssl = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_notifications.driver = [] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_notifications.retry = -1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] key_manager.fixed_key = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.barbican_api_version = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.barbican_endpoint = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.barbican_endpoint_type = public {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.barbican_region_name = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.cafile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.collect_timing = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.insecure = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.number_of_retries = 60 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.retry_delay = 1 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.send_service_user_token = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.split_loggers = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.timeout = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.tls_ciphers = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.tls_min_version = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.verify_ssl = True {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican.verify_ssl_path = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.auth_section = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.auth_type = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.cafile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.certfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.collect_timing = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.insecure = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.keyfile = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.split_loggers = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.timeout = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.tls_ciphers = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] barbican_service_user.tls_min_version = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.approle_role_id = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.approle_secret_id = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.auth_method = approle {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.auth_path = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.kv_mountpoint = secret {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.kv_path = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.kv_version = 2 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.namespace = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.root_token_id = **** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.ssl_ca_crt_file = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.timeout = 60.0 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.token_file = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.token_role = None {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.use_ssl = False {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:09 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] ******************************************************************************** {{(pid=86269) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] CMD "mount.quobyte" returned: 1 in 0.165s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=86486) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:34:09 devstack cinder-volume[86486]: INFO cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 ... Nov 05 17:34:09 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e -c /etc/quobyte/client-cinder.cfg {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:09 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e -c /etc/quobyte/client-cinder.cfg Nov 05 17:34:09 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:10 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.382s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:10 devstack cinder-volume[86486]: INFO cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 succeeded Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=86486) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.397s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:10 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:34:10 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:10 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.249s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:10 devstack cinder-volume[86486]: INFO cinder.volume.driver [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.volume.driver [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552764892578, 'free_capacity_gb': 1773.4552764892578, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86486) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG dbcounter [-] [86486] Writer thread running {{(pid=86486) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.db.api [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Building query based on filter {{(pid=86486) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.image.image_utils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86486) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 17:34:10 devstack cinder-volume[86486]: INFO cinder.keymgr.migration [None req-57ac218f-b376-4875-a8de-26ef988350ba None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=86486) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=86486) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:10 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:34:10 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:10 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.216s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.manager [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Notifying Schedulers of capabilities ... {{(pid=86486) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:34:10 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Driver initialization completed successfully. Nov 05 17:34:10 devstack cinder-volume[86486]: INFO cinder.manager [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Initiating service 3 cleanup Nov 05 17:34:10 devstack cinder-volume[86486]: INFO cinder.manager [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Service 3 cleanup completed. Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.service [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Creating RPC server for service cinder-volume {{(pid=86486) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 17:34:10 devstack cinder-volume[86486]: DEBUG cinder.service [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86486) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 17:34:11 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 17:34:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:34:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:34:11 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=86486) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:34:11 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=86486) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:34:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:34:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:11 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:34:11 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:11 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.244s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:11 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-c6d636e0-f272-469a-bd4c-d7dae7587160 None None] Driver post RPC initialization completed successfully. Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=86486) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=86486) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:15 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:34:15 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:15 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.230s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:15 devstack cinder-volume[86486]: DEBUG cinder.manager [None req-265468e6-fced-44ee-a236-a464792a87f5 None None] Notifying Schedulers of capabilities ... {{(pid=86486) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:34:16 devstack cinder-volume[86269]: INFO oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Caught SIGTERM, stopping children Nov 05 17:34:16 devstack cinder-volume[86269]: DEBUG oslo_concurrency.lockutils [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Acquiring lock "singleton_lock" {{(pid=86269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 17:34:16 devstack cinder-volume[86269]: DEBUG oslo_concurrency.lockutils [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Acquired lock "singleton_lock" {{(pid=86269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 17:34:16 devstack cinder-volume[86269]: DEBUG oslo_concurrency.lockutils [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Releasing lock "singleton_lock" {{(pid=86269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 17:34:16 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Stop services. {{(pid=86269) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 17:34:16 devstack cinder-volume[86269]: DEBUG oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Killing children. {{(pid=86269) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 17:34:16 devstack cinder-volume[86269]: INFO oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Waiting on 1 children to exit Nov 05 17:34:19 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Acquiring lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 17:34:19 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Acquired lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 17:34:19 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Releasing lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 17:34:19 devstack cinder-volume[86486]: WARNING amqp [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 17:34:19 devstack cinder-volume[86486]: WARNING amqp [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 17:34:19 devstack cinder-volume[86269]: INFO oslo_service.backend._eventlet.service [None req-673ba061-4757-48c5-823a-25dedfdd5255 None None] Child 86486 exited with status 0 Nov 05 17:34:19 devstack cinder-volume[86802]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 17:34:19 devstack cinder-volume[86802]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 17:34:19 devstack cinder-volume[86802]: we strongly recommend against using it for new projects. Nov 05 17:34:19 devstack cinder-volume[86802]: If you are already using Eventlet, we recommend migrating to a different Nov 05 17:34:19 devstack cinder-volume[86802]: framework. For more detail see Nov 05 17:34:19 devstack cinder-volume[86802]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 17:34:19 devstack cinder-volume[86802]: import eventlet # noqa Nov 05 17:34:22 devstack cinder-volume[86802]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 17:34:22 devstack cinder-volume[86802]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 17:34:22 devstack cinder-volume[86802]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 17:34:23 devstack cinder-volume[86802]: INFO dbcounter [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Registered counter for database cinder Nov 05 17:34:23 devstack cinder-volume[86802]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86802) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG dbcounter [-] [86802] Writer thread running {{(pid=86802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 17:34:24 devstack cinder-volume[86802]: INFO cinder.rpc [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 17:34:24 devstack cinder-volume[86802]: INFO cinder.rpc [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86802) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:24 devstack cinder-volume[86802]: INFO cinder.volume.manager [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Determined volume DB was empty at startup. Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG cinder.volume.manager [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86802) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 17:34:24 devstack cinder-volume[86802]: WARNING stevedore.named [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 17:34:24 devstack cinder-volume[86802]: WARNING castellan.key_manager [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 17:34:24 devstack cinder-volume[86802]: WARNING cinder.keymgr.conf_key_mgr [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 17:34:24 devstack cinder-volume[86802]: INFO cinder.volume.manager [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86802) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:24 devstack cinder-volume[86802]: INFO oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Starting 1 workers Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Started child 87126 {{(pid=86802) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Full set of CONF: {{(pid=86802) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] ******************************************************************************** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] Configuration options gathered from: {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] ================================================================================ {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] allow_availability_zone_fallback = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] allow_compression_on_image_upload = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] allowed_direct_url_schemes = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] api_rate_limit = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] auth_strategy = keystone {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_availability_zone = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_host = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_stats_polling_interval = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[87126]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backup_api_class = cinder.backup.api.API {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backup_name_template = backup-%s {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backup_use_same_host = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backup_use_temp_snapshot = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] chap_password = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] chap_username = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_internal_tenant_project_id = e11f3d3f51b744869316bc1c20566dda {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_internal_tenant_user_id = e8267fb348e04490b75d79a4245861cc {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cluster = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] compression_format = gzip {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] compute_api_class = cinder.compute.nova.API {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] config_dir = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] config_source = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] control_exchange = openstack {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] debug = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] default_availability_zone = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] default_group_type = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] default_volume_type = QuobyteHD {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] disk_geometry = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] driver_client_cert = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] driver_client_cert_key = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] driver_data_namespace = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] driver_ssl_cert_path = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] driver_ssl_cert_verify = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] driver_use_ssl = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] enable_new_services = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] enable_unsupported_driver = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] enabled_backends = ['QuobyteHD'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] enforce_multipath_for_image_xfer = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] filter_function = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_api_insecure = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_api_servers = ['http://192.168.122.242/image'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87126) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_api_ssl_compression = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_ca_certificates_file = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_catalog_info = image:glance:publicURL {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_num_retries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance_request_timeout = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] goodness_function = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] graceful_shutdown_timeout = 5 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] group_api_class = cinder.group.api.API {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] host = devstack {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_compress_on_upload = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_conversion_address_space_limit = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_conversion_cpu_limit = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_conversion_disable = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_introspection_address_space_limit = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_introspection_cpu_limit = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_upload_use_cinder_backend = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_upload_use_internal_tenant = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_volume_cache_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_volume_cache_max_count = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] image_volume_cache_max_size_gb = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] init_host_max_objects_retrieval = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] instance_format = [instance: %(uuid)s] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] iscsi_target_flags = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] iscsi_write_cache = on {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] iser_helper = tgtadm {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] iser_ip_address = 192.168.122.242 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] iser_port = 3260 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_color = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_config_append = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_dir = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_file = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_options = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_rotate_interval = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_rotate_interval_type = days {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] log_rotation_type = none {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] max_age = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] max_logfile_count = 30 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] max_logfile_size_mb = 200 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] max_over_subscription_ratio = 20.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] message_reap_interval = 86400 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] message_ttl = 2592000 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] migration_create_volume_timeout_secs = 300 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] monkey_patch = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] monkey_patch_modules = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] my_ip = 192.168.122.242 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] no_snapshot_gb_quota = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] num_iser_scan_tries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] num_shell_tries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] num_volume_device_scan_tries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] nvmeof_conn_info_version = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] nvmet_ns_id = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] nvmet_port_id = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] osapi_max_limit = 1000 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] osapi_volume_ext_list = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] osapi_volume_listen_port = 8776 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] osapi_volume_use_ssl = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] osapi_volume_workers = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] per_volume_size_limit = -1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87126) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 17:34:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 17:34:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] periodic_fuzzy_delay = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] periodic_interval = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] public_endpoint = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] publish_errors = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] quota_backup_gigabytes = 1000 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] quota_backups = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Running cmd (subprocess): mount.quobyte {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] quota_gigabytes = 1000 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] quota_groups = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] quota_snapshots = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] quota_volumes = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] rate_limit_burst = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] rate_limit_except_level = CRITICAL {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] rate_limit_interval = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] reinit_driver_count = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] replication_device = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] report_discard_supported = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] report_interval = 120 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] reservation_clean_interval = 86400 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] reservation_expire = 86400 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] reserved_image_namespaces = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] reserved_percentage = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] rpc_response_timeout = 120 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] run_external_periodic_tasks = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] scst_target_driver = iscsi {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] scst_target_iqn_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_down_time = 720 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] shell_completion = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] snapshot_name_template = snapshot-%s {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] split_loggers = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] state_path = /opt/stack/data/cinder {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] storage_availability_zone = nova {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] storage_protocol = iSCSI {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] syslog_log_facility = LOG_USER {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] target_helper = lioadm {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] target_ip_address = 192.168.122.242 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] target_port = 3260 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] target_protocol = iscsi {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] target_secondary_ip_addresses = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] trace_flags = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] transport_url = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] until_refresh = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] use_chap_auth = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] use_default_quota_class = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] use_journal = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] use_json = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] use_multipath_for_image_xfer = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] use_stderr = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] use_syslog = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] verify_glance_signatures = enabled {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_api_class = cinder.volume.api.API {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_backend_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_clear = zero {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_clear_ionice = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_clear_size = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_copy_bps_limit = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_dd_blocksize = 1M {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_name_template = volume-%s {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_service_inithost_offload = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volume_usage_audit_period = month {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] zoning_mode = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_concurrency.disable_process_locking = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.auth_section = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.auth_type = password {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.auth_version = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.cache = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack quobyte-client[87134]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 17:34:24 devstack quobyte-client[87134]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.include_service_catalog = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.insecure = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.interface = public {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_password = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcache_username = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.region_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.service_type = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.242/identity {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.backend = dogpile.cache.null {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.backend_argument = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.backend_expiration_time = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.config_prefix = cache.oslo {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.debug_cache_backend = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.enable_retry_client = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.enable_socket_keepalive = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.expiration_time = 600 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.hashclient_retry_attempts = 2 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.memcache_dead_retry = 300 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.memcache_pool_maxsize = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.memcache_sasl_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.password = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.proxies = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.redis_db = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.redis_server = localhost:6379 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.retry_attempts = 2 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.retry_delay = 0.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.socket_keepalive_count = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.socket_keepalive_idle = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.socket_keepalive_interval = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.socket_timeout = 1.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.tls_allowed_ciphers = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.tls_cafile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.tls_certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.tls_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.tls_keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cache.username = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] coordination.backend_url = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.asyncio_connection = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.asyncio_slave_connection = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.backend = sqlalchemy {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.connection = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.connection_debug = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.connection_parameters = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.connection_recycle_time = 3600 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.connection_trace = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.db_inc_retry_interval = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.db_max_retries = 20 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.db_max_retry_interval = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.db_retry_interval = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.max_overflow = 50 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.max_pool_size = 5 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.max_retries = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.mysql_wsrep_sync_wait = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.pool_timeout = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.retry_interval = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.slave_connection = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.sqlite_synchronous = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.synchronous_reader = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] database.use_db_reconnect = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_tracing.insecure = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.connection_string = messaging:// {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.es_doc_type = notification {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.es_scroll_size = 10000 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.es_scroll_time = 2m {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.filter_error_trace = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.hmac_keys = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.sentinel_service_name = mymaster {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.socket_timeout = 0.1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.trace_requests = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler.trace_sqlalchemy = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler_jaeger.process_tags = {} {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler_jaeger.service_name_prefix = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] profiler_otlp.service_name_prefix = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.enforce_new_defaults = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.policy_default_rule = default {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.policy_file = policy.yaml {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] privsep_osbrick.group = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] privsep_osbrick.helper_command = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] privsep_osbrick.user = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_sys_admin.group = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_sys_admin.helper_command = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] cinder_sys_admin.user = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.auth_section = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.auth_type = password {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.cafile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.collect_timing = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.insecure = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.send_service_user_token = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.split_loggers = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.timeout = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.tls_ciphers = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] service_user.tls_min_version = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.auth_section = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.auth_type = password {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.collect_timing = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.insecure = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.region_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.split_loggers = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.timeout = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.tls_ciphers = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] glance.tls_min_version = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.backend_availability_zone = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.chap_password = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.chap_username = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.disk_geometry = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.driver_client_cert = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.driver_client_cert_key = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.driver_data_namespace = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.driver_use_ssl = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.extra_capabilities = {} {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.filter_function = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.goodness_function = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.iscsi_target_flags = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.iscsi_write_cache = on {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.iser_helper = tgtadm {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.iser_ip_address = 192.168.122.242 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.iser_port = 3260 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_host = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_login = admin {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_mount_options = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_password = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_private_key = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_share_path = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.num_shell_tries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.quobyte_volume_url = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.replication_device = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.report_discard_supported = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.reserved_percentage = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.target_helper = tgtadm {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.target_ip_address = 192.168.122.242 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.target_port = 3260 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.target_protocol = iscsi {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.trace_flags = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.unique_fqdn_network = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.use_chap_auth = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_backend_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_clear = zero {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_clear_ionice = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_clear_size = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_reports.file_event_handler = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_reports.log_dir = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.backend_availability_zone = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.backend_host = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.chap_password = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.chap_username = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.chiscsi_conf = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.disk_geometry = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.driver_client_cert = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.driver_data_namespace = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.driver_use_ssl = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.extra_capabilities = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.filter_function = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.goodness_function = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.iser_helper = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.iser_ip_address = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.iser_port = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.iser_target_prefix = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_host = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_login = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_mount_options = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_password = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_private_key = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_share_path = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_ssh_port = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.num_shell_tries = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.nvmet_port_id = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.replication_device = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.report_discard_supported = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.reserved_percentage = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.scst_target_driver = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.storage_protocol = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.target_helper = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.target_ip_address = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.target_port = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.target_prefix = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.target_protocol = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.trace_flags = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.use_chap_auth = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_clear = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_clear_size = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] QuobyteHD.volumes_dir = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.ssl = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_notifications.driver = [] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_notifications.retry = -1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] key_manager.fixed_key = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.barbican_api_version = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.barbican_endpoint = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.barbican_endpoint_type = public {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.barbican_region_name = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.cafile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.collect_timing = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.insecure = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.number_of_retries = 60 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.retry_delay = 1 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.send_service_user_token = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.split_loggers = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.timeout = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.tls_ciphers = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.tls_min_version = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.verify_ssl = True {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican.verify_ssl_path = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.auth_section = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.auth_type = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.cafile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.certfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.collect_timing = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.insecure = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.keyfile = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.split_loggers = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.timeout = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.tls_ciphers = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] barbican_service_user.tls_min_version = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.approle_role_id = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.approle_secret_id = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.auth_method = approle {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.auth_path = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.kv_mountpoint = secret {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.kv_path = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.kv_version = 2 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.namespace = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.root_token_id = **** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.ssl_ca_crt_file = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.timeout = 60.0 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.token_file = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.token_role = None {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.use_ssl = False {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 17:34:24 devstack cinder-volume[86802]: DEBUG oslo_service.backend._eventlet.service [None req-8a2ac5bc-803a-4c21-80f9-b23fd24bf026 None None] ******************************************************************************** {{(pid=86802) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 17:34:25 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:25 devstack cinder-volume[87126]: INFO cinder.volume.driver [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.volume.driver [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552764892578, 'free_capacity_gb': 1773.4552764892578, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_db.sqlalchemy.engines [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writer thread running {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.db.api [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Building query based on filter {{(pid=87126) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87126) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:25 devstack cinder-volume[87126]: INFO cinder.keymgr.migration [None req-65df4226-5252-4938-b981-7edfc2f0a1f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 17:34:25 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:34:25 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:25 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.229s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:34:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Driver initialization completed successfully. Nov 05 17:34:25 devstack cinder-volume[87126]: INFO cinder.manager [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Initiating service 3 cleanup Nov 05 17:34:25 devstack cinder-volume[87126]: INFO cinder.manager [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Service 3 cleanup completed. Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.service [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Creating RPC server for service cinder-volume {{(pid=87126) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.service [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87126) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 17:34:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:34:25 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:34:25 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:34:25 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Nov 05 17:34:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:34:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d2547a8c-5a05-4d26-8d3a-ffcf6af04440 None None] Driver post RPC initialization completed successfully. Nov 05 17:34:34 devstack cinder-volume[86802]: DEBUG dbcounter [-] [86802] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:34:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:34:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:35:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:35:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 6 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:35:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Flow 'volume_create_manager' (240688b8-005a-402f-a456-3448f5824bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b685ac8-3291-4469-939a-e74a296c1fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b685ac8-3291-4469-939a-e74a296c1fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-34666594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aac5a6-3d2e-47c9-9b99-db31239bcd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80562604b58047ffa55fa2f3269701cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:35:24Z,use_quota=True,user_id='3b8b6ad442954a83901ec97a010bb726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb87fd-c0b8-482a-a094-e8c5a6b1e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb87fd-c0b8-482a-a094-e8c5a6b1e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e592e3-fbd7-4e51-bb1d-06578bbd40b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e592e3-fbd7-4e51-bb1d-06578bbd40b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6aac5a6-3d2e-47c9-9b99-db31239bcd15', 'volume_name': 'volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9776d5-ec9e-4237-80f6-a6fc91ccefd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9776d5-ec9e-4237-80f6-a6fc91ccefd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f384b4-e7bc-46ea-a230-1f71d739af37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Volume a6aac5a6-3d2e-47c9-9b99-db31239bcd15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15', 'volume_size': 1} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-34666594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aac5a6-3d2e-47c9-9b99-db31239bcd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80562604b58047ffa55fa2f3269701cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:35:24Z,use_quota=True,user_id='3b8b6ad442954a83901ec97a010bb726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Creating volume a6aac5a6-3d2e-47c9-9b99-db31239bcd15 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:35:24 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:35:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:35:24 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 1073741824 Nov 05 17:35:24 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:25 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 1073741824" returned: 0 in 0.812s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:35:25 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 Nov 05 17:35:25 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:25 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f384b4-e7bc-46ea-a230-1f71d739af37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c68dc43-4213-4b8c-ba89-02efea4f539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Volume volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 (a6aac5a6-3d2e-47c9-9b99-db31239bcd15): created successfully Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c68dc43-4213-4b8c-ba89-02efea4f539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Flow 'volume_create_manager' (240688b8-005a-402f-a456-3448f5824bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:35:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fbc06dc2-1eac-4b3b-92a2-d1297801e364 tempest-TaggedAttachmentsTest-38671017 None] Created volume successfully. Nov 05 17:35:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:35:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Flow 'volume_create_manager' (9a1c73a2-b0e5-48ed-a427-28315dc0996b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c72569-9e27-4e76-9787-92b1244f9dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c72569-9e27-4e76-9787-92b1244f9dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1301061490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145afcbf-81b0-41da-b250-935e196cb460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac18c1f7a94f431692e7efd4e1f3202c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:35:50Z,use_quota=True,user_id='f4cfa13076154e8b9ce8b693e1e5fd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4442017e-c576-4541-ab75-76c0b558a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4442017e-c576-4541-ab75-76c0b558a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ad0e2f-69cd-43a6-bb56-4a49f3c0db0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ad0e2f-69cd-43a6-bb56-4a49f3c0db0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145afcbf-81b0-41da-b250-935e196cb460', 'volume_name': 'volume-145afcbf-81b0-41da-b250-935e196cb460', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b117789-c3f6-4ba5-b37b-a5feca94f890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b117789-c3f6-4ba5-b37b-a5feca94f890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0804aaaa-4de6-4a96-9a03-7cbf3f8a7bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Volume 145afcbf-81b0-41da-b250-935e196cb460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145afcbf-81b0-41da-b250-935e196cb460', 'volume_size': 1} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1301061490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145afcbf-81b0-41da-b250-935e196cb460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac18c1f7a94f431692e7efd4e1f3202c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:35:50Z,use_quota=True,user_id='f4cfa13076154e8b9ce8b693e1e5fd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Creating volume 145afcbf-81b0-41da-b250-935e196cb460 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:35:50 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:35:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:35:50 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 1073741824 Nov 05 17:35:50 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:51 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 1073741824" returned: 0 in 1.126s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:35:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:35:51 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 Nov 05 17:35:51 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:52 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:35:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:35:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:35:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0804aaaa-4de6-4a96-9a03-7cbf3f8a7bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145afcbf-81b0-41da-b250-935e196cb460', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3559d48e-51a8-4804-8a7d-56fe5078e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:35:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Volume volume-145afcbf-81b0-41da-b250-935e196cb460 (145afcbf-81b0-41da-b250-935e196cb460): created successfully Nov 05 17:35:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3559d48e-51a8-4804-8a7d-56fe5078e13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:35:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Flow 'volume_create_manager' (9a1c73a2-b0e5-48ed-a427-28315dc0996b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:35:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c4215e63-b316-43f4-9b3a-103bb0291cfb tempest-VolumesAdminNegativeTest-1054157590 None] Created volume successfully. Nov 05 17:35:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Acquiring lock "cinder-145afcbf-81b0-41da-b250-935e196cb460-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:35:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Lock "cinder-145afcbf-81b0-41da-b250-935e196cb460-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:35:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Acquiring lock "cinder-quobyte-145afcbf-81b0-41da-b250-935e196cb460" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:35:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Lock "cinder-quobyte-145afcbf-81b0-41da-b250-935e196cb460" acquired by "delete_volume" :: waited 0.091s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:35:53 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_dr0smbp/privsep.sock'] Nov 05 17:35:53 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_dr0smbp/privsep.sock Nov 05 17:35:53 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 17:35:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 17:35:55 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:55 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Spawned new privsep daemon via rootwrap Nov 05 17:35:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Accepted privsep connection to /tmp/tmp_dr0smbp/privsep.sock {{(pid=87126) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 17:35:55 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 17:35:55 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 17:35:55 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 17:35:55 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88298 Nov 05 17:35:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[238316f7-7ddb-4005-b636-ba86b2cce4c7]: (2,) {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:35:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[477174ea-3463-4b1b-bcde-836040083e3c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:35:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:35:56 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 Nov 05 17:35:56 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:56 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460" returned: 0 in 0.853s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:35:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:35:56 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460 Nov 05 17:35:56 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:56 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-145afcbf-81b0-41da-b250-935e196cb460" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Lock "cinder-quobyte-145afcbf-81b0-41da-b250-935e196cb460" released by "delete_volume" :: held 3.640s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:35:57 devstack cinder-volume[87126]: WARNING cinder.quota [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:35:57 devstack cinder-volume[87126]: WARNING cinder.quota [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Created reservations ['b909a16f-4d8f-41d9-b48c-1ce62f4c4897', 'c53e1f07-2536-4e52-b122-c447f9ef14d7', 'd25dbfab-350a-4288-8850-fe008ab47340', 'aa1bce23-aab1-4b38-8080-1988a18aede2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:35:57 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:35:57 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:35:57 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:35:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Deleted volume successfully. Nov 05 17:35:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dc84161-24c0-4b52-85d9-ef86d4d95503 tempest-VolumesAdminNegativeTest-1054157590 None] Lock "cinder-145afcbf-81b0-41da-b250-935e196cb460-delete_volume" released by "delete_volume" :: held 4.577s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:07 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=18,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:36:07 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Flow 'volume_create_manager' (d860617a-8fbf-4980-afb8-8807c610a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f60d13-db5e-4c61-a24f-c70525a46d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f60d13-db5e-4c61-a24f-c70525a46d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2138116891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47be8f0a-972f-4390-ac13-e97d49fdc9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74085dc98f7146498a50ccbc9c3bc077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:08Z,use_quota=True,user_id='17c595e5775946789c25756c189b637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a41197d-1a7b-4c58-adae-882dbf5536c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a41197d-1a7b-4c58-adae-882dbf5536c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01326da6-16eb-4de6-97fe-889062bb91a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01326da6-16eb-4de6-97fe-889062bb91a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47be8f0a-972f-4390-ac13-e97d49fdc9fc', 'volume_name': 'volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805ed6a4-787c-4ee8-8562-526554a7f86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805ed6a4-787c-4ee8-8562-526554a7f86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd58938-f09c-4bf9-8374-785075225b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Volume 47be8f0a-972f-4390-ac13-e97d49fdc9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc', 'volume_size': 1} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2138116891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47be8f0a-972f-4390-ac13-e97d49fdc9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74085dc98f7146498a50ccbc9c3bc077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:08Z,use_quota=True,user_id='17c595e5775946789c25756c189b637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Creating volume 47be8f0a-972f-4390-ac13-e97d49fdc9fc {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:36:08 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:36:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:08 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc 1073741824 Nov 05 17:36:08 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:09 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc 1073741824" returned: 0 in 0.723s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:09 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc Nov 05 17:36:09 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Flow 'volume_create_manager' (faceef5b-52f2-41dc-af8a-cfb72fb7b29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a54bbc8-27d5-4d51-a317-447824c23e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a54bbc8-27d5-4d51-a317-447824c23e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-718758771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2192059c-a68b-4a88-b2f7-3c537dd85c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f37f86f904542b997e31d9a13c99acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:10Z,use_quota=True,user_id='5f0d67f0b1d84a4cb02799cc40bbfd6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464ffbbb-a7f5-43f8-b547-c25e2727d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464ffbbb-a7f5-43f8-b547-c25e2727d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83f0cda-0a21-4199-a6cb-aac6da8fd238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83f0cda-0a21-4199-a6cb-aac6da8fd238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2192059c-a68b-4a88-b2f7-3c537dd85c54', 'volume_name': 'volume-2192059c-a68b-4a88-b2f7-3c537dd85c54', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c061c7b-085f-4fa5-a973-30d108b2d23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c061c7b-085f-4fa5-a973-30d108b2d23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f443184-c43e-4553-aad8-a5ca8dd716a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Volume 2192059c-a68b-4a88-b2f7-3c537dd85c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2192059c-a68b-4a88-b2f7-3c537dd85c54', 'volume_size': 1} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:09 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-718758771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2192059c-a68b-4a88-b2f7-3c537dd85c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f37f86f904542b997e31d9a13c99acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:10Z,use_quota=True,user_id='5f0d67f0b1d84a4cb02799cc40bbfd6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Creating volume 2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:36:09 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:09 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 1073741824 Nov 05 17:36:09 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd58938-f09c-4bf9-8374-785075225b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9de063-d771-4998-bfc0-3fc40c3d4014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Volume volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc (47be8f0a-972f-4390-ac13-e97d49fdc9fc): created successfully Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9de063-d771-4998-bfc0-3fc40c3d4014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Flow 'volume_create_manager' (d860617a-8fbf-4980-afb8-8807c610a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d6e3327f-81e2-4652-8745-b04efcd54da9 tempest-ServerActionsTestOtherA-596570974 None] Created volume successfully. Nov 05 17:36:10 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 1073741824" returned: 0 in 0.504s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:10 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 Nov 05 17:36:10 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:10 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f443184-c43e-4553-aad8-a5ca8dd716a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2192059c-a68b-4a88-b2f7-3c537dd85c54', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249fee43-5aa8-4338-8461-a0df52e9438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:10 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Volume volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 (2192059c-a68b-4a88-b2f7-3c537dd85c54): created successfully Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249fee43-5aa8-4338-8461-a0df52e9438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Flow 'volume_create_manager' (faceef5b-52f2-41dc-af8a-cfb72fb7b29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-6a23e5b2-d54e-411d-a2a2-61226b084710 req-5a96184d-40fd-4730-a963-9119538295e1 tempest-VolumesSnapshotsTestJSON-1685971305 None] Created volume successfully. Nov 05 17:36:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Creating offline snapshot 5815c690-c3a4-49e5-b923-fee276a8c6a8 of volume 2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:36:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b971a34-80ac-4fd4-a740-d6cd304844df]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:12 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 Nov 05 17:36:12 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:12 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:12 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 1G Nov 05 17:36:12 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:13 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 1G" returned: 0 in 0.618s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:13 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 Nov 05 17:36:13 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:13 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:13 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 is being set with open permissions: ugo+rw Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:13 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 Nov 05 17:36:13 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:13 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:36:13 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:14 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:14 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.info Nov 05 17:36:14 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:14 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.468s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 8 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:36:14 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.info" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:14 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.info is being set with open permissions: ugo+rw Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:14 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.info Nov 05 17:36:14 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:14 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.info" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-e972d535-c531-4881-8699-1cff83126d0d req-a3672114-185b-4d4c-ae00-e316a019847d tempest-VolumesSnapshotsTestJSON-1685971305 None] Create snapshot completed successfully Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "cinder-5815c690-c3a4-49e5-b923-fee276a8c6a8-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-5815c690-c3a4-49e5-b923-fee276a8c6a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "cinder-quobyte-2192059c-a68b-4a88-b2f7-3c537dd85c54" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-quobyte-2192059c-a68b-4a88-b2f7-3c537dd85c54" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "cinder-quobyte-5815c690-c3a4-49e5-b923-fee276a8c6a8" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-quobyte-5815c690-c3a4-49e5-b923-fee276a8c6a8" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Deleting offline snapshot 5815c690-c3a4-49e5-b923-fee276a8c6a8 of volume 2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] snapshot_file for this snap is: volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb639f67-eb2c-45ba-a3d8-9c024f0bf76b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:16 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 Nov 05 17:36:16 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:16 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8" returned: 0 in 0.767s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2192059c-a68b-4a88-b2f7-3c537dd85c54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:36:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55e87c2-1ec3-4ab9-9461-da046647a92f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:16 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 Nov 05 17:36:16 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:17 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54" returned: 0 in 0.640s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:17 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 Nov 05 17:36:17 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:18 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8" returned: 0 in 0.831s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:18 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8 Nov 05 17:36:18 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:18 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54.5815c690-c3a4-49e5-b923-fee276a8c6a8" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-quobyte-5815c690-c3a4-49e5-b923-fee276a8c6a8" released by "_delete_snapshot" :: held 2.852s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-quobyte-2192059c-a68b-4a88-b2f7-3c537dd85c54" released by "delete_snapshot" :: held 2.899s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:18 devstack cinder-volume[87126]: WARNING cinder.quota [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:36:18 devstack cinder-volume[87126]: DEBUG cinder.quota [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Created reservations ['c8f20b8d-b6c3-41d2-a0b4-c588041fcd38', '4e742d00-7372-4a49-969e-7edaca4ce948', 'afda72ff-ca3b-4dc0-8ca8-7349fcdd526e', 'b97aa167-4f13-4637-ac61-a61ea25b372b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:36:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Delete snapshot completed successfully. Nov 05 17:36:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-64b1020d-ad47-4528-81eb-a582d1cfc8df req-78acc87a-a980-436c-88b5-ae224ca60c86 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-5815c690-c3a4-49e5-b923-fee276a8c6a8-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "cinder-2192059c-a68b-4a88-b2f7-3c537dd85c54-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-2192059c-a68b-4a88-b2f7-3c537dd85c54-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "cinder-quobyte-2192059c-a68b-4a88-b2f7-3c537dd85c54" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-quobyte-2192059c-a68b-4a88-b2f7-3c537dd85c54" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e1f5fa-e8e3-4f68-ab48-0bd4cc9e16fa]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:19 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 Nov 05 17:36:19 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:20 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54" returned: 0 in 0.672s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:20 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54 Nov 05 17:36:20 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:20 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2192059c-a68b-4a88-b2f7-3c537dd85c54" returned: 0 in 0.602s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-quobyte-2192059c-a68b-4a88-b2f7-3c537dd85c54" released by "delete_volume" :: held 1.411s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:20 devstack cinder-volume[87126]: DEBUG cinder.quota [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Created reservations ['d6eb4d4e-d720-4b97-bc51-03bcf41d92c3', '9c9f091f-38c7-4d6a-a383-4abb0484496b', '42d16a80-8297-41bd-9525-b9ca40190457', '05d78f73-8e0f-4866-8965-14f1fc7a46b9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:21 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:36:21 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:21 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG cinder.manager [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:36:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Deleted volume successfully. Nov 05 17:36:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-f153327d-0969-4958-90f7-cb7692ee190e req-f407a687-65a4-48e0-8aad-d00342f2a655 tempest-VolumesSnapshotsTestJSON-1685971305 None] Lock "cinder-2192059c-a68b-4a88-b2f7-3c537dd85c54-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa56c139-2c4e-44fd-8215-1de7267a7268 tempest-GroupSnapshotsTest-1876055469 None] Group tempest-GroupSnapshotsTest-Group-985199209: creating Nov 05 17:36:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa56c139-2c4e-44fd-8215-1de7267a7268 tempest-GroupSnapshotsTest-1876055469 None] Group tempest-GroupSnapshotsTest-Group-985199209: created successfully Nov 05 17:36:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa56c139-2c4e-44fd-8215-1de7267a7268 tempest-GroupSnapshotsTest-1876055469 None] Create group completed successfully. Nov 05 17:36:31 devstack cinder-volume[87126]: WARNING py.warnings [req-5a423cf8-5499-4a9f-856f-589c29a54105 req-66a985b6-10dd-40cb-b4bb-9c81742285cd tempest-TaggedAttachmentsTest-38671017 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 05 17:36:31 devstack cinder-volume[87126]: .first() Nov 05 17:36:31 devstack cinder-volume[87126]: Nov 05 17:36:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-5a423cf8-5499-4a9f-856f-589c29a54105 req-66a985b6-10dd-40cb-b4bb-9c81742285cd tempest-TaggedAttachmentsTest-38671017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-5a423cf8-5499-4a9f-856f-589c29a54105 req-66a985b6-10dd-40cb-b4bb-9c81742285cd tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-5a423cf8-5499-4a9f-856f-589c29a54105 req-66a985b6-10dd-40cb-b4bb-9c81742285cd tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-5a423cf8-5499-4a9f-856f-589c29a54105 req-66a985b6-10dd-40cb-b4bb-9c81742285cd tempest-TaggedAttachmentsTest-38671017 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53142f4f-fb0a-470a-8453-91dc2462199c', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:36:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-5a423cf8-5499-4a9f-856f-589c29a54105 req-66a985b6-10dd-40cb-b4bb-9c81742285cd tempest-TaggedAttachmentsTest-38671017 None] attachment_update completed successfully. Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (c6212b84-3d69-43e9-9fc2-ee3ca9dceb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95731d9a-f4b6-4551-8b4c-8d1c3cb5a587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95731d9a-f4b6-4551-8b4c-8d1c3cb5a587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366452041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3894df61-41d4-4ea6-831f-3a8df421c05f,host='devstack@QuobyteHD#QuobyteHD',id=1103a354-fd59-477c-adc8-424849bc7bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:33Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(611c994d-c755-4a79-a478-ec6d516b9b2e),volume_type_id=611c994d-c755-4a79-a478-ec6d516b9b2e)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faeb93e-be1b-4599-bbfc-022bcca6b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faeb93e-be1b-4599-bbfc-022bcca6b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9c9b40-cb38-4227-b659-d006ef71ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9c9b40-cb38-4227-b659-d006ef71ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1103a354-fd59-477c-adc8-424849bc7bb7', 'volume_name': 'volume-1103a354-fd59-477c-adc8-424849bc7bb7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5d2d5a-a4ea-4635-b575-ca4d5a5f4c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5d2d5a-a4ea-4635-b575-ca4d5a5f4c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02729d6-bffc-4315-8e08-737f11e89948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Volume 1103a354-fd59-477c-adc8-424849bc7bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1103a354-fd59-477c-adc8-424849bc7bb7', 'volume_size': 1} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3894df61-41d4-4ea6-831f-3a8df421c05f,created_at=2026-11-05T16:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366452041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3894df61-41d4-4ea6-831f-3a8df421c05f,host='devstack@QuobyteHD#QuobyteHD',id=1103a354-fd59-477c-adc8-424849bc7bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:33Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(611c994d-c755-4a79-a478-ec6d516b9b2e),volume_type_id=611c994d-c755-4a79-a478-ec6d516b9b2e)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Creating volume 1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:36:32 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:36:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:32 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 1073741824 Nov 05 17:36:32 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:33 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 1073741824" returned: 0 in 0.523s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:33 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 Nov 05 17:36:33 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:33 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02729d6-bffc-4315-8e08-737f11e89948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1103a354-fd59-477c-adc8-424849bc7bb7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e35648-2bba-42a6-ae50-1f955fa46840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Volume volume-1103a354-fd59-477c-adc8-424849bc7bb7 (1103a354-fd59-477c-adc8-424849bc7bb7): created successfully Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e35648-2bba-42a6-ae50-1f955fa46840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (c6212b84-3d69-43e9-9fc2-ee3ca9dceb68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e953fa2e-7654-4a68-8cb4-f43c94bd854a tempest-GroupSnapshotsTest-1876055469 None] Created volume successfully. Nov 05 17:36:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] GroupSnapshot cb6993e1-7f24-4b6b-b8f1-e3fb56f465af: creating. Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Group snapshot cb6993e1-7f24-4b6b-b8f1-e3fb56f465af: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Creating offline snapshot 3de13843-f37b-42fc-9679-ee1e0ff5b69b of volume 1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9ee0db-efe8-4f10-9045-8f01645e7501]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:34 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 Nov 05 17:36:34 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:34 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7" returned: 0 in 0.484s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:34 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b 1G Nov 05 17:36:34 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:35 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b 1G" returned: 0 in 0.530s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1103a354-fd59-477c-adc8-424849bc7bb7 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:35 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1103a354-fd59-477c-adc8-424849bc7bb7 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b Nov 05 17:36:35 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:35 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1103a354-fd59-477c-adc8-424849bc7bb7 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:35 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:36:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:35 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b Nov 05 17:36:35 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-bfa2bded-3ee6-4ae4-9d44-17fe1f8e1d43 req-ab244311-3ae4-4f97-a5c1-9701b79264ee tempest-TaggedAttachmentsTest-38671017 None] Terminate volume connection completed successfully. Nov 05 17:36:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-bfa2bded-3ee6-4ae4-9d44-17fe1f8e1d43 req-ab244311-3ae4-4f97-a5c1-9701b79264ee tempest-TaggedAttachmentsTest-38671017 None] Deleting attachment 53142f4f-fb0a-470a-8453-91dc2462199c. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:36:35 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:35 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.info Nov 05 17:36:35 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:36 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.info" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:36 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:36:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:36 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.info Nov 05 17:36:36 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.info" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:36 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3d4db2f4-afcd-4702-a07a-445085916b57 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot cb6993e1-7f24-4b6b-b8f1-e3fb56f465af: created successfully Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-3de13843-f37b-42fc-9679-ee1e0ff5b69b-49089841-6312-41e1-81bb-d2fad944db69" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-3de13843-f37b-42fc-9679-ee1e0ff5b69b-49089841-6312-41e1-81bb-d2fad944db69" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Creating volume 49089841-6312-41e1-81bb-d2fad944db69 from snapshot 3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-49089841-6312-41e1-81bb-d2fad944db69" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-49089841-6312-41e1-81bb-d2fad944db69" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] snapshot: 3de13843-f37b-42fc-9679-ee1e0ff5b69b, volume: 49089841-6312-41e1-81bb-d2fad944db69, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[626eb271-f4d9-4832-9e2e-15feee100b84]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:39 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b Nov 05 17:36:39 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:39 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b" returned: 0 in 0.638s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1103a354-fd59-477c-adc8-424849bc7bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:36:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aa8503-4bcd-407a-8781-9a3bebf3a02d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:39 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 Nov 05 17:36:39 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:40 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7" returned: 0 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:36:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:36:40 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:36:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:40 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 Nov 05 17:36:40 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8f840da6-1d62-4289-b51f-bf40e3017393 req-f9d1c165-6911-47d4-97c1-65004724faa2 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:49 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69" returned: 0 in 9.750s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:49 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7, size 1024.00 MB, duration 9.75 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:36:49 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Converted 1024.00 MB image at 105.02 MB/s Nov 05 17:36:49 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:36:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:49 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 Nov 05 17:36:49 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:50 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-49089841-6312-41e1-81bb-d2fad944db69" released by "_copy_volume_from_snapshot" :: held 11.508s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-3de13843-f37b-42fc-9679-ee1e0ff5b69b-49089841-6312-41e1-81bb-d2fad944db69" released by "_create_volume_from_snapshot" :: held 11.614s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.645s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8f840da6-1d62-4289-b51f-bf40e3017393 req-f9d1c165-6911-47d4-97c1-65004724faa2 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.809s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8f840da6-1d62-4289-b51f-bf40e3017393 req-f9d1c165-6911-47d4-97c1-65004724faa2 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.163s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8f840da6-1d62-4289-b51f-bf40e3017393 req-f9d1c165-6911-47d4-97c1-65004724faa2 tempest-ServerActionsTestOtherA-596570974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ff55f35-db45-491c-b3b3-37f1a969958f', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:36:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-485fe6e4-57c0-4611-9204-a3d28082d2ba tempest-GroupSnapshotsTest-1876055469 None] Create group from source-snapshot-cb6993e1-7f24-4b6b-b8f1-e3fb56f465af completed successfully. Nov 05 17:36:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-8f840da6-1d62-4289-b51f-bf40e3017393 req-f9d1c165-6911-47d4-97c1-65004724faa2 tempest-ServerActionsTestOtherA-596570974 None] attachment_update completed successfully. Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Acquiring lock "cinder-a6aac5a6-3d2e-47c9-9b99-db31239bcd15-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Lock "cinder-a6aac5a6-3d2e-47c9-9b99-db31239bcd15-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Acquiring lock "cinder-quobyte-a6aac5a6-3d2e-47c9-9b99-db31239bcd15" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Lock "cinder-quobyte-a6aac5a6-3d2e-47c9-9b99-db31239bcd15" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32a0ced-f1b1-492a-b112-a12a5dcbfda1]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:51 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 Nov 05 17:36:51 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:51 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15" returned: 0 in 0.489s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:51 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15 Nov 05 17:36:51 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-49089841-6312-41e1-81bb-d2fad944db69" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-49089841-6312-41e1-81bb-d2fad944db69" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2598e28b-e1a6-4caf-81bd-7e5445d10ab2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:51 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6aac5a6-3d2e-47c9-9b99-db31239bcd15" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Lock "cinder-quobyte-a6aac5a6-3d2e-47c9-9b99-db31239bcd15" released by "delete_volume" :: held 0.901s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:52 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 Nov 05 17:36:52 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Created reservations ['86432e72-704b-48bc-8774-faee1015aa2a', '1044994a-368b-4c80-969f-47c7671a6f00', '6501e02a-7692-416d-85a0-c22e8a706610', 'c1578c2b-2578-48c5-b7fc-6ed90600aadb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:52 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:36:52 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:52 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69" returned: 0 in 0.547s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:52 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69 Nov 05 17:36:52 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:52 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:36:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Deleted volume successfully. Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4c5948f4-cac2-48ff-98aa-7fa90a73cf36 tempest-TaggedAttachmentsTest-38671017 None] Lock "cinder-a6aac5a6-3d2e-47c9-9b99-db31239bcd15-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49089841-6312-41e1-81bb-d2fad944db69" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-49089841-6312-41e1-81bb-d2fad944db69" released by "delete_volume" :: held 0.906s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:52 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['3ca6ba5d-4389-4d39-9245-a176b6c066c1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:36:52 devstack cinder-volume[87126]: WARNING cinder.quota [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1019942310 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1019942310, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:36:52 devstack cinder-volume[87126]: WARNING cinder.quota [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1019942310 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1019942310, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:36:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['d3f7c56b-d872-4760-9823-63c70b751e0c', 'ce7bea2e-ab0b-453d-b137-377fd23a554b', 'edd9603a-c823-4720-83d5-d401666beb75', 'd58fb59d-3950-496a-bee0-a0523ef5342b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:53 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:36:53 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:53 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.467s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:53 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:36:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-37d8caff-bdf7-4a19-809c-dfd323e64787 tempest-GroupSnapshotsTest-1876055469 None] Delete group completed successfully. Nov 05 17:36:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot cb6993e1-7f24-4b6b-b8f1-e3fb56f465af: deleting Nov 05 17:36:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot cb6993e1-7f24-4b6b-b8f1-e3fb56f465af: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 17:36:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-1103a354-fd59-477c-adc8-424849bc7bb7" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-1103a354-fd59-477c-adc8-424849bc7bb7" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-3de13843-f37b-42fc-9679-ee1e0ff5b69b" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:36:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-3de13843-f37b-42fc-9679-ee1e0ff5b69b" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:36:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Deleting offline snapshot 3de13843-f37b-42fc-9679-ee1e0ff5b69b of volume 1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] snapshot_file for this snap is: volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353e9d0-0f7a-462f-9e06-0b8a915490c4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:55 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b Nov 05 17:36:55 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-2e19a9c8-455a-4fce-abfb-93c703d17be4 req-593a1aa2-1aaf-4302-a794-977918809731 tempest-ServerActionsTestOtherA-596570974 None] Terminate volume connection completed successfully. Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-2e19a9c8-455a-4fce-abfb-93c703d17be4 req-593a1aa2-1aaf-4302-a794-977918809731 tempest-ServerActionsTestOtherA-596570974 None] Deleting attachment 0ff55f35-db45-491c-b3b3-37f1a969958f. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:36:55 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b" returned: 0 in 0.746s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1103a354-fd59-477c-adc8-424849bc7bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640c87b-618f-4122-a972-c4b24ff8abed]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:36:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:56 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 Nov 05 17:36:56 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Flow 'volume_create_manager' (1aa5db4f-a408-4901-bb95-85f5a7cae2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1e4762-8439-4d88-93be-c5c2ab0638d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1e4762-8439-4d88-93be-c5c2ab0638d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-860184603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a6b4e8-6aca-43bf-8774-3bc33cadd8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f110f222e9fb4629ba5243f9e20f44c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:57Z,use_quota=True,user_id='0afd2b7941f94067aee512c19b76cdfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87073b2-5edf-499a-9191-b4435a0d0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87073b2-5edf-499a-9191-b4435a0d0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4764c06-264a-46ae-bb5c-77c82e5284d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4764c06-264a-46ae-bb5c-77c82e5284d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a6b4e8-6aca-43bf-8774-3bc33cadd8fa', 'volume_name': 'volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce663712-f977-4fb2-a078-644b483ffdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce663712-f977-4fb2-a078-644b483ffdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919eeb48-e8be-41eb-bfa3-12681c52c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Volume 49a6b4e8-6aca-43bf-8774-3bc33cadd8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa', 'volume_size': 1} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-860184603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a6b4e8-6aca-43bf-8774-3bc33cadd8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f110f222e9fb4629ba5243f9e20f44c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:36:57Z,use_quota=True,user_id='0afd2b7941f94067aee512c19b76cdfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Creating volume 49a6b4e8-6aca-43bf-8774-3bc33cadd8fa {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:36:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-2e19a9c8-455a-4fce-abfb-93c703d17be4 req-87664bf4-7470-497f-aaba-1b2309b228cd tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:36:57 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:57 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa 1073741824 Nov 05 17:36:57 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7" returned: 0 in 1.507s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:57 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b Nov 05 17:36:57 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:57 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:57 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b Nov 05 17:36:57 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:58 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa 1073741824" returned: 0 in 0.688s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:36:58 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa Nov 05 17:36:58 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:36:58 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7.3de13843-f37b-42fc-9679-ee1e0ff5b69b" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-3de13843-f37b-42fc-9679-ee1e0ff5b69b" released by "_delete_snapshot" :: held 3.268s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-1103a354-fd59-477c-adc8-424849bc7bb7" released by "delete_snapshot" :: held 3.346s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:36:58 devstack cinder-volume[87126]: WARNING cinder.quota [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1019942310 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1019942310, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['49a58e48-82bf-42e1-83f8-7c2b424f0041', 'd2b0000f-3b9a-4a15-9220-18cfeeccb9f6', '12478104-ebed-4b90-86f2-f0a74cd96077', '7e3df66b-cd15-445f-899f-4bcf8956ee67'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:36:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9294fa99-050f-4be1-9c58-a063eda884f1 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot cb6993e1-7f24-4b6b-b8f1-e3fb56f465af: deleted successfully Nov 05 17:36:58 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa" returned: 0 in 0.467s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-2e19a9c8-455a-4fce-abfb-93c703d17be4 req-87664bf4-7470-497f-aaba-1b2309b228cd tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.193s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919eeb48-e8be-41eb-bfa3-12681c52c215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9e00ca-dea9-4a11-ba0d-6a49360de327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-2e19a9c8-455a-4fce-abfb-93c703d17be4 req-87664bf4-7470-497f-aaba-1b2309b228cd tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:36:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Volume volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa (49a6b4e8-6aca-43bf-8774-3bc33cadd8fa): created successfully Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9e00ca-dea9-4a11-ba0d-6a49360de327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Flow 'volume_create_manager' (1aa5db4f-a408-4901-bb95-85f5a7cae2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:36:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-478e51cb-0a5f-4df8-b52a-d87f8bcba836 tempest-DeleteServersTestJSON-1268929848 None] Created volume successfully. Nov 05 17:36:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-2e19a9c8-455a-4fce-abfb-93c703d17be4 req-87664bf4-7470-497f-aaba-1b2309b228cd tempest-ServerActionsTestOtherA-596570974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73233ee7-09a4-43f6-a7ab-450e719eb8d7', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:36:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-2e19a9c8-455a-4fce-abfb-93c703d17be4 req-87664bf4-7470-497f-aaba-1b2309b228cd tempest-ServerActionsTestOtherA-596570974 None] attachment_update completed successfully. Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-1103a354-fd59-477c-adc8-424849bc7bb7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-1103a354-fd59-477c-adc8-424849bc7bb7" acquired by "delete_volume" :: waited 0.054s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[841c6cf9-bc10-45c3-9310-27c99aa041c6]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b9ddbb8c-00df-472b-9da0-4a85d19170c6 req-9f5429ec-9f87-452f-a3c7-6834d4dad91d tempest-DeleteServersTestJSON-1268929848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b9ddbb8c-00df-472b-9da0-4a85d19170c6 req-9f5429ec-9f87-452f-a3c7-6834d4dad91d tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b9ddbb8c-00df-472b-9da0-4a85d19170c6 req-9f5429ec-9f87-452f-a3c7-6834d4dad91d tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-b9ddbb8c-00df-472b-9da0-4a85d19170c6 req-9f5429ec-9f87-452f-a3c7-6834d4dad91d tempest-DeleteServersTestJSON-1268929848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '630c2d88-1e63-440c-81b5-f015f7bac359', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:37:00 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 Nov 05 17:37:00 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-b9ddbb8c-00df-472b-9da0-4a85d19170c6 req-9f5429ec-9f87-452f-a3c7-6834d4dad91d tempest-DeleteServersTestJSON-1268929848 None] attachment_update completed successfully. Nov 05 17:37:01 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7" returned: 0 in 1.093s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:01 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7 Nov 05 17:37:01 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:02 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1103a354-fd59-477c-adc8-424849bc7bb7" returned: 0 in 0.768s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-1103a354-fd59-477c-adc8-424849bc7bb7" released by "delete_volume" :: held 2.015s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['df8a461e-dbd1-4c4e-9092-fe44bff65a20'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:02 devstack cinder-volume[87126]: WARNING cinder.db.api [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1019942310'] Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['f1a76afe-22e5-49f6-a929-5548f6847e2f', '5b1cee10-dc77-4d22-9aa1-21414183d2b9', '755564b8-8960-43db-a9f0-e29588abadce', 'c8dcad49-77b1-4619-8c1c-0a09d5c78618'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:02 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:37:02 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:03 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.470s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:03 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:37:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a82f5d63-44c9-4f17-8da8-3ead27761d4e tempest-GroupSnapshotsTest-1876055469 None] Delete group completed successfully. Nov 05 17:37:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8edbce5d-fc5f-4c95-8dba-4323034a067c tempest-GroupSnapshotsTest-1876055469 None] Group tempest-GroupSnapshotsTest-Group-1590799804: creating Nov 05 17:37:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8edbce5d-fc5f-4c95-8dba-4323034a067c tempest-GroupSnapshotsTest-1876055469 None] Group tempest-GroupSnapshotsTest-Group-1590799804: created successfully Nov 05 17:37:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8edbce5d-fc5f-4c95-8dba-4323034a067c tempest-GroupSnapshotsTest-1876055469 None] Create group completed successfully. Nov 05 17:37:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-a912c2e0-abc3-498b-b12d-774fdff6245b req-c7e182b8-7492-4c39-b082-02b301777779 tempest-DeleteServersTestJSON-1268929848 None] Terminate volume connection completed successfully. Nov 05 17:37:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-a912c2e0-abc3-498b-b12d-774fdff6245b req-c7e182b8-7492-4c39-b082-02b301777779 tempest-DeleteServersTestJSON-1268929848 None] Deleting attachment 630c2d88-1e63-440c-81b5-f015f7bac359. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (b93b5b8e-233f-4574-be17-e11e8b683171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09afeedf-3af9-42be-9d12-977486599e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09afeedf-3af9-42be-9d12-977486599e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252442057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=450e5267-7a1d-4515-9d51-92202f06cc34,host='devstack@QuobyteHD#QuobyteHD',id=bcaf0dcb-fb38-42a7-b495-bda8e38815c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:06Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241cfde0-0abc-4a1c-8173-041cf9f58791),volume_type_id=241cfde0-0abc-4a1c-8173-041cf9f58791)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00635950-6243-4907-af51-174f1f4fdf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00635950-6243-4907-af51-174f1f4fdf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ed3192-eb69-4462-a171-6f99ac9381c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ed3192-eb69-4462-a171-6f99ac9381c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcaf0dcb-fb38-42a7-b495-bda8e38815c4', 'volume_name': 'volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7305c0d2-f15a-4693-8151-d878dfddc7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7305c0d2-f15a-4693-8151-d878dfddc7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e585d-350c-4c04-8cea-43ab4a863854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Volume bcaf0dcb-fb38-42a7-b495-bda8e38815c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4', 'volume_size': 1} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=450e5267-7a1d-4515-9d51-92202f06cc34,created_at=2026-11-05T16:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252442057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=450e5267-7a1d-4515-9d51-92202f06cc34,host='devstack@QuobyteHD#QuobyteHD',id=bcaf0dcb-fb38-42a7-b495-bda8e38815c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:06Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241cfde0-0abc-4a1c-8173-041cf9f58791),volume_type_id=241cfde0-0abc-4a1c-8173-041cf9f58791)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Creating volume bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:37:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:06 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 1073741824 Nov 05 17:37:06 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:06 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 1073741824" returned: 0 in 0.641s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:07 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 Nov 05 17:37:07 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Acquiring lock "cinder-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Lock "cinder-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=98,cinder:UPDATE=74,cinder:INSERT=24,cinder:DELETE=4 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:37:07 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Acquiring lock "cinder-quobyte-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e585d-350c-4c04-8cea-43ab4a863854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd487b1-5c0d-42ef-9771-34a0108d64ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Lock "cinder-quobyte-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Volume volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 (bcaf0dcb-fb38-42a7-b495-bda8e38815c4): created successfully Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd487b1-5c0d-42ef-9771-34a0108d64ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (b93b5b8e-233f-4574-be17-e11e8b683171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ec5bbf-0f37-4329-89ec-f7fe5bb70d35]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4e16ca41-237f-4a5e-a9ad-137ec59c6f9a tempest-GroupSnapshotsTest-1876055469 None] Created volume successfully. Nov 05 17:37:07 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa Nov 05 17:37:07 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:07 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa" returned: 0 in 0.403s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:07 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa Nov 05 17:37:07 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:08 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Lock "cinder-quobyte-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa" released by "delete_volume" :: held 0.799s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=98,cinder:UPDATE=83,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Created reservations ['c77c087f-d93a-4fdc-bc49-4008853dfae7', 'dd0f7864-10de-4418-9797-2ec80fe176c2', 'a1b6af50-1bc5-49de-8957-0d23f1147723', '5a2f811c-de7a-48aa-ad64-b3c0f0ab5aae'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (8d4bd558-8006-46f4-9387-ed383faf71f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561236d7-9ecd-4033-acd4-2cc39cab6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561236d7-9ecd-4033-acd4-2cc39cab6cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524597370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=450e5267-7a1d-4515-9d51-92202f06cc34,host='devstack@QuobyteHD#QuobyteHD',id=89559101-5aed-4277-943c-40635aaf7a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:08Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241cfde0-0abc-4a1c-8173-041cf9f58791),volume_type_id=241cfde0-0abc-4a1c-8173-041cf9f58791)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07aab599-8a70-4100-bf3f-ea5e2c21f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07aab599-8a70-4100-bf3f-ea5e2c21f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a4b35d-5b0c-4bbc-8838-39337762d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a4b35d-5b0c-4bbc-8838-39337762d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89559101-5aed-4277-943c-40635aaf7a29', 'volume_name': 'volume-89559101-5aed-4277-943c-40635aaf7a29', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2640882e-0b85-4f07-af29-a341cae35191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2640882e-0b85-4f07-af29-a341cae35191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e46f09-9184-4b7b-a6d9-c2b0df59e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Volume 89559101-5aed-4277-943c-40635aaf7a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89559101-5aed-4277-943c-40635aaf7a29', 'volume_size': 1} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=450e5267-7a1d-4515-9d51-92202f06cc34,created_at=2026-11-05T16:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524597370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=450e5267-7a1d-4515-9d51-92202f06cc34,host='devstack@QuobyteHD#QuobyteHD',id=89559101-5aed-4277-943c-40635aaf7a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:08Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241cfde0-0abc-4a1c-8173-041cf9f58791),volume_type_id=241cfde0-0abc-4a1c-8173-041cf9f58791)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Creating volume 89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:37:08 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:08 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 1073741824 Nov 05 17:37:08 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:08 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:37:08 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:08 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.300s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:37:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Deleted volume successfully. Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-59b6dc96-93e1-4735-b7b2-993e4e3f5f2f tempest-DeleteServersTestJSON-1268929848 None] Lock "cinder-49a6b4e8-6aca-43bf-8774-3bc33cadd8fa-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:09 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 1073741824" returned: 0 in 0.532s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:09 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 Nov 05 17:37:09 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:09 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e46f09-9184-4b7b-a6d9-c2b0df59e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89559101-5aed-4277-943c-40635aaf7a29', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ed21a2-f85f-4da1-8054-5ec05062c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Volume volume-89559101-5aed-4277-943c-40635aaf7a29 (89559101-5aed-4277-943c-40635aaf7a29): created successfully Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ed21a2-f85f-4da1-8054-5ec05062c677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (8d4bd558-8006-46f4-9387-ed383faf71f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6013b67c-0ffc-4f19-8ce4-2fb9b9799106 tempest-GroupSnapshotsTest-1876055469 None] Created volume successfully. Nov 05 17:37:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2b5bbc0d-7491-440d-911a-168fbfd6928a tempest-GroupSnapshotsTest-1876055469 None] Update group completed successfully. Nov 05 17:37:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e4bcad1b-6d67-4387-bb96-6cef0f1cd21d tempest-GroupSnapshotsTest-1876055469 None] Update group completed successfully. Nov 05 17:37:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b6e0bd6e-f9d3-4d22-b797-2ec4a60594f1 tempest-GroupSnapshotsTest-1876055469 None] Update group completed successfully. Nov 05 17:37:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:37:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:13 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:37:13 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:14 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.396s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:37:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a9a630f6-2b05-46a4-b0b0-0c5da24507d2 tempest-GroupSnapshotsTest-1876055469 None] Update group completed successfully. Nov 05 17:37:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] GroupSnapshot 02a17a1f-465d-492d-a29e-adf30041f3ed: creating. Nov 05 17:37:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Group snapshot 02a17a1f-465d-492d-a29e-adf30041f3ed: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 17:37:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Creating offline snapshot b5445013-5e3b-414c-bc1c-c0b7058cd700 of volume 89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:37:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2138a61-5aa1-4cba-be96-df117c942b19]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:16 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 Nov 05 17:37:16 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:17 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29" returned: 0 in 0.478s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:17 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 1G Nov 05 17:37:17 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:17 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 1G" returned: 0 in 0.501s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89559101-5aed-4277-943c-40635aaf7a29 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:17 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89559101-5aed-4277-943c-40635aaf7a29 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 Nov 05 17:37:17 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:18 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89559101-5aed-4277-943c-40635aaf7a29 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:37:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:18 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 Nov 05 17:37:18 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:18 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:18 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.info Nov 05 17:37:18 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:18 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.info" returned: 0 in 0.300s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:37:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:18 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.info Nov 05 17:37:18 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:19 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.info" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Creating offline snapshot ec474bd1-96b7-45ff-a30e-2be7592fdfb8 of volume bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbef5147-33e4-4569-bcf8-45ba19bd202d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:19 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 Nov 05 17:37:19 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:19 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" returned: 0 in 0.574s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:19 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 1G Nov 05 17:37:19 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:20 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 1G" returned: 0 in 0.527s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:20 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 Nov 05 17:37:20 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:20 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8" returned: 0 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:20 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:37:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:20 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 Nov 05 17:37:20 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:20 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:21 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.info Nov 05 17:37:21 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:21 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.info" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:21 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:37:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:21 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.info Nov 05 17:37:21 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:21 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.info" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2bff02c6-6c79-4deb-9464-a41899884c90 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 02a17a1f-465d-492d-a29e-adf30041f3ed: created successfully Nov 05 17:37:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 02a17a1f-465d-492d-a29e-adf30041f3ed: deleting Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 02a17a1f-465d-492d-a29e-adf30041f3ed: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-89559101-5aed-4277-943c-40635aaf7a29" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-89559101-5aed-4277-943c-40635aaf7a29" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-b5445013-5e3b-414c-bc1c-c0b7058cd700" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-b5445013-5e3b-414c-bc1c-c0b7058cd700" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Deleting offline snapshot b5445013-5e3b-414c-bc1c-c0b7058cd700 of volume 89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] snapshot_file for this snap is: volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f4c03-f5ce-4a8c-b13b-54b45a2c63e5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:22 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 Nov 05 17:37:22 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:22 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700" returned: 0 in 0.525s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89559101-5aed-4277-943c-40635aaf7a29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e80a8-bde2-4c4f-8035-196c0f3a1c15]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:23 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 Nov 05 17:37:23 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:23 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:23 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 Nov 05 17:37:23 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:23 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700" returned: 0 in 0.555s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:24 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700 Nov 05 17:37:24 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:24 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29.b5445013-5e3b-414c-bc1c-c0b7058cd700" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-b5445013-5e3b-414c-bc1c-c0b7058cd700" released by "_delete_snapshot" :: held 2.037s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-89559101-5aed-4277-943c-40635aaf7a29" released by "delete_snapshot" :: held 2.075s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-ec474bd1-96b7-45ff-a30e-2be7592fdfb8" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-ec474bd1-96b7-45ff-a30e-2be7592fdfb8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Deleting offline snapshot ec474bd1-96b7-45ff-a30e-2be7592fdfb8 of volume bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] snapshot_file for this snap is: volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c68f9a-403e-4620-9539-df968d816444]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:24 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 Nov 05 17:37:24 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:25 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8" returned: 0 in 0.769s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:37:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ca797-aef8-4e01-8554-c7a387f59985]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:25 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 Nov 05 17:37:25 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:26 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" returned: 0 in 0.795s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:26 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 Nov 05 17:37:26 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:26 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8" returned: 0 in 0.706s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:26 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8 Nov 05 17:37:26 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:27 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4.ec474bd1-96b7-45ff-a30e-2be7592fdfb8" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-ec474bd1-96b7-45ff-a30e-2be7592fdfb8" released by "_delete_snapshot" :: held 2.806s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" released by "delete_snapshot" :: held 2.846s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:27 devstack cinder-volume[87126]: WARNING cinder.quota [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1434657398 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1434657398, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:37:27 devstack cinder-volume[87126]: WARNING cinder.quota [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1434657398 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1434657398, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:37:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['a395d4f9-a1bd-4eb3-904f-e3beae6823d6', 'e5768db3-5994-4cbe-bb48-26e70cfa6c3c', 'f6fc1d47-c339-4afb-a583-4fed1e72c56c', '878d5d20-e819-4ef1-9c97-63c7dade9442'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['e56c2ca4-afee-4aac-9338-5056aa395736', '562cec3f-6f9b-44c0-8951-048b3db247f3', 'd1e9f95b-d842-4265-86c1-527b7d7dce20', '3ccf5edb-8981-4b96-ad84-804f11ed35e8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b7b24156-78bb-4f79-bd31-25170f148212 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 02a17a1f-465d-492d-a29e-adf30041f3ed: deleted successfully Nov 05 17:37:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-d9937f0b-8beb-4698-8e16-13f937ae4498 req-1a14a589-f401-4033-b173-d2848fcc517c tempest-ServerActionsTestOtherA-596570974 None] Terminate volume connection completed successfully. Nov 05 17:37:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-d9937f0b-8beb-4698-8e16-13f937ae4498 req-1a14a589-f401-4033-b173-d2848fcc517c tempest-ServerActionsTestOtherA-596570974 None] Deleting attachment 73233ee7-09a4-43f6-a7ab-450e719eb8d7. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:37:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-89559101-5aed-4277-943c-40635aaf7a29" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-89559101-5aed-4277-943c-40635aaf7a29" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c584b67-44f2-4eff-983a-127431412758]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:28 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 Nov 05 17:37:28 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:29 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29" returned: 0 in 0.565s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:29 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29 Nov 05 17:37:29 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:29 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89559101-5aed-4277-943c-40635aaf7a29" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-89559101-5aed-4277-943c-40635aaf7a29" released by "delete_volume" :: held 1.157s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" acquired by "delete_volume" :: waited 0.044s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3f488-309b-49c7-9e30-1e5cada78421]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:30 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 Nov 05 17:37:30 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:30 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" returned: 0 in 0.583s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:30 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4 Nov 05 17:37:30 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:30 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" returned: 0 in 0.342s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-bcaf0dcb-fb38-42a7-b495-bda8e38815c4" released by "delete_volume" :: held 1.132s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['cf61e555-8e59-4219-8333-d855dc443c11'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:31 devstack cinder-volume[87126]: WARNING cinder.quota [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1434657398 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1434657398, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['f64e4864-f74a-4206-9b43-558da7a5dc09', '3a771745-c4c3-43b6-b7be-fe09d90c6dd9', 'eb0ec7e1-dbe2-4f94-8a36-c4d641ac395b', 'd379d78d-1260-4cbd-ba28-4e24cf6127cb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['f551430e-2f91-4bc9-b7ca-235203e95ff4', '4736fafa-3558-4002-841b-9fdde3b11b59', 'ee7df47b-0ce6-4966-a8cb-6037c0cba2f5', '12cf9b7d-0055-46cf-9e37-59dd4652fa35'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:31 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:37:31 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:31 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.390s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:31 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:37:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3afd50e7-ae98-46a6-90c0-c09d59abaf8b tempest-GroupSnapshotsTest-1876055469 None] Delete group completed successfully. Nov 05 17:37:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4f596350-52f5-421d-ad4f-46f02870f236 tempest-GroupSnapshotsTest-1876055469 None] Group tempest-GroupSnapshotsTest-Group-1971360752: creating Nov 05 17:37:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4f596350-52f5-421d-ad4f-46f02870f236 tempest-GroupSnapshotsTest-1876055469 None] Group tempest-GroupSnapshotsTest-Group-1971360752: created successfully Nov 05 17:37:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4f596350-52f5-421d-ad4f-46f02870f236 tempest-GroupSnapshotsTest-1876055469 None] Create group completed successfully. Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (e7d42484-8b68-4e1d-8cb3-643beb237683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e335dc-de00-467d-8b94-e96e6d4b28ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e335dc-de00-467d-8b94-e96e6d4b28ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1731580202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e64b6af8-64be-4722-bd1b-4d7baf1c6497,host='devstack@QuobyteHD#QuobyteHD',id=5fc04592-45c9-4a54-9623-a44b068d7dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:35Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ce640bc-99bf-4b73-9468-458fbe23baa5),volume_type_id=7ce640bc-99bf-4b73-9468-458fbe23baa5)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0b646-11a1-4775-8a6c-8175d32ebdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0b646-11a1-4775-8a6c-8175d32ebdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363c0076-0277-4d78-b6e8-f47d34beb42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363c0076-0277-4d78-b6e8-f47d34beb42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc04592-45c9-4a54-9623-a44b068d7dad', 'volume_name': 'volume-5fc04592-45c9-4a54-9623-a44b068d7dad', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e896f0c-a692-4dc1-8cd6-caee4ddeaecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e896f0c-a692-4dc1-8cd6-caee4ddeaecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31fa1c10-8ed2-4ce0-ab83-d043a57b2242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Volume 5fc04592-45c9-4a54-9623-a44b068d7dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc04592-45c9-4a54-9623-a44b068d7dad', 'volume_size': 1} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e64b6af8-64be-4722-bd1b-4d7baf1c6497,created_at=2026-11-05T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1731580202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e64b6af8-64be-4722-bd1b-4d7baf1c6497,host='devstack@QuobyteHD#QuobyteHD',id=5fc04592-45c9-4a54-9623-a44b068d7dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b92366498fa4beea15ec11814aff4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:35Z,use_quota=True,user_id='7219666c685044bfa5c1402ad18e4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ce640bc-99bf-4b73-9468-458fbe23baa5),volume_type_id=7ce640bc-99bf-4b73-9468-458fbe23baa5)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Creating volume 5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:37:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:35 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad 1073741824 Nov 05 17:37:35 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:35 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad 1073741824" returned: 0 in 0.564s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:36 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad Nov 05 17:37:36 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad" returned: 0 in 0.388s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:37:36 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31fa1c10-8ed2-4ce0-ab83-d043a57b2242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc04592-45c9-4a54-9623-a44b068d7dad', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3f9314-fc90-4913-a6e9-8ed46e483e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Volume volume-5fc04592-45c9-4a54-9623-a44b068d7dad (5fc04592-45c9-4a54-9623-a44b068d7dad): created successfully Nov 05 17:37:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3f9314-fc90-4913-a6e9-8ed46e483e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Flow 'volume_create_manager' (e7d42484-8b68-4e1d-8cb3-643beb237683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2efe207f-3f54-4191-8b5c-25966f039f45 tempest-GroupSnapshotsTest-1876055469 None] Created volume successfully. Nov 05 17:37:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] GroupSnapshot 1dd106e8-c296-4b35-b81d-de48627db3a1: creating. Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Group snapshot 1dd106e8-c296-4b35-b81d-de48627db3a1: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Creating offline snapshot 98ea1115-cc67-4be2-b430-c3ca582a03e9 of volume 5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Flow 'volume_create_manager' (7c24c9c7-0bec-47e0-873e-27efcd189944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf1af86-e22b-4ceb-bb5a-e3cf388c40c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdfdb3c-2007-48e6-974a-90160ca34db5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf1af86-e22b-4ceb-bb5a-e3cf388c40c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-42884039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886a445e-51e1-4beb-8d04-b95b76d20e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74085dc98f7146498a50ccbc9c3bc077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:38Z,use_quota=True,user_id='17c595e5775946789c25756c189b637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b807b1-0892-41af-86c1-51d519b0d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b807b1-0892-41af-86c1-51d519b0d362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d056977-7e67-412e-88fb-305a41a9acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:37:38 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad Nov 05 17:37:38 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:38 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad" returned: 0 in 0.664s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:38 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 1G Nov 05 17:37:38 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:39 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 1G" returned: 0 in 0.663s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc04592-45c9-4a54-9623-a44b068d7dad -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d056977-7e67-412e-88fb-305a41a9acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '886a445e-51e1-4beb-8d04-b95b76d20e7d', 'volume_name': 'volume-886a445e-51e1-4beb-8d04-b95b76d20e7d', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:39 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc04592-45c9-4a54-9623-a44b068d7dad -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 Nov 05 17:37:39 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fdde18-ef6a-4af6-a34c-b843b7af8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fdde18-ef6a-4af6-a34c-b843b7af8087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0464cc1d-a9f9-4763-b88a-2c18aa3e595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Volume 886a445e-51e1-4beb-8d04-b95b76d20e7d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-886a445e-51e1-4beb-8d04-b95b76d20e7d', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 17:37:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Trying to clone 886a445e-51e1-4beb-8d04-b95b76d20e7d from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:37:40 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Image download 20.69 MB at 20.69 MB/s Nov 05 17:37:40 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc04592-45c9-4a54-9623-a44b068d7dad -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9" returned: 0 in 0.544s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:40 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:40 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 Nov 05 17:37:40 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de9c3c-1336-4633-9379-318a37812cd8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:40 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD Nov 05 17:37:40 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:40 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9" returned: 0 in 0.412s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:40 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.info Nov 05 17:37:40 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:40 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:40 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a is fetched for user 17c595e5775946789c25756c189b637e. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:37:41 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.info" returned: 0 in 0.470s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:41 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:41 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.info Nov 05 17:37:41 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0009249d-1d05-4e2c-8591-595889999bcd]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:41 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD Nov 05 17:37:41 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:41 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.info" returned: 0 in 0.505s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.437s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:41 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-42884039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886a445e-51e1-4beb-8d04-b95b76d20e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74085dc98f7146498a50ccbc9c3bc077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:38Z,use_quota=True,user_id='17c595e5775946789c25756c189b637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Creating volume 886a445e-51e1-4beb-8d04-b95b76d20e7d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:37:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:41 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d 1073741824 Nov 05 17:37:41 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1021cd53-0ac2-421e-afc3-fe21c459edc0 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 1dd106e8-c296-4b35-b81d-de48627db3a1: created successfully Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Flow 'volume_create_manager' (5127adff-fa39-4fde-a7d2-8aeebe43b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b8e3e9-ef5b-4019-98de-35c923532998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b8e3e9-ef5b-4019-98de-35c923532998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-284163679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5624304-8033-4627-bb97-5ac64edcae1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436302c1b7d04822bb299005c6fb3f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:42Z,use_quota=True,user_id='3dc1325e34984ad5a13173b85e6a9b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c53eb9-c2f1-4160-a09a-20f6aade01df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c53eb9-c2f1-4160-a09a-20f6aade01df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79faf03-c738-498a-a15c-0e9e918009e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79faf03-c738-498a-a15c-0e9e918009e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5624304-8033-4627-bb97-5ac64edcae1e', 'volume_name': 'volume-b5624304-8033-4627-bb97-5ac64edcae1e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dc3854-5511-47e0-b788-dff141998465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dc3854-5511-47e0-b788-dff141998465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6323a952-12af-4751-ab68-5d63caea6ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Volume b5624304-8033-4627-bb97-5ac64edcae1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5624304-8033-4627-bb97-5ac64edcae1e', 'volume_size': 1} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:42 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d 1073741824" returned: 0 in 0.629s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:42 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d Nov 05 17:37:42 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:42 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-284163679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5624304-8033-4627-bb97-5ac64edcae1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436302c1b7d04822bb299005c6fb3f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:37:42Z,use_quota=True,user_id='3dc1325e34984ad5a13173b85e6a9b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Creating volume b5624304-8033-4627-bb97-5ac64edcae1e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:37:42 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:42 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e 1073741824 Nov 05 17:37:42 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Attempting download of 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 886a445e-51e1-4beb-8d04-b95b76d20e7d. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[17220b26-4ae5-4032-9a30-a9c12be5ea0f]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_fhubz63u {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 1dd106e8-c296-4b35-b81d-de48627db3a1: deleting Nov 05 17:37:42 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_fhubz63u Nov 05 17:37:42 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 1dd106e8-c296-4b35-b81d-de48627db3a1: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 17:37:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-5fc04592-45c9-4a54-9623-a44b068d7dad" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-5fc04592-45c9-4a54-9623-a44b068d7dad" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-98ea1115-cc67-4be2-b430-c3ca582a03e9" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-98ea1115-cc67-4be2-b430-c3ca582a03e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Deleting offline snapshot 98ea1115-cc67-4be2-b430-c3ca582a03e9 of volume 5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] snapshot_file for this snap is: volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[706a0eb2-5e59-4a76-b3cd-a0a01d405212]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:43 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_fhubz63u" returned: 0 in 0.495s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_fhubz63u {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:43 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 Nov 05 17:37:43 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:43 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e 1073741824" returned: 0 in 0.688s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:43 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_fhubz63u Nov 05 17:37:43 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:43 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e Nov 05 17:37:43 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:43 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9" returned: 0 in 0.508s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fc04592-45c9-4a54-9623-a44b068d7dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:37:43 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_fhubz63u" returned: 1 in 0.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_fhubz63u' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[31622225-8ab6-42a4-9755-018ecf312dcf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3169940-68d7-4b8c-a55e-693cb8bd62c9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:43 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6323a952-12af-4751-ab68-5d63caea6ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5624304-8033-4627-bb97-5ac64edcae1e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb0ba7f-0390-40f4-b56f-165467c50f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Volume volume-b5624304-8033-4627-bb97-5ac64edcae1e (b5624304-8033-4627-bb97-5ac64edcae1e): created successfully Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb0ba7f-0390-40f4-b56f-165467c50f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Flow 'volume_create_manager' (5127adff-fa39-4fde-a7d2-8aeebe43b47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-54e31455-4e39-48ad-9d4c-7ceb7961df16 tempest-VolumesServicesTestJSON-1183064479 None] Created volume successfully. Nov 05 17:37:43 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD Nov 05 17:37:43 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:43 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad Nov 05 17:37:43 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:44 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] 801ade9d-3bc5-40a6-b715-627da3a7cb0a was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:44 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:44 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d Nov 05 17:37:44 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:44 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 Nov 05 17:37:44 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Acquiring lock "cinder-b5624304-8033-4627-bb97-5ac64edcae1e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Lock "cinder-b5624304-8033-4627-bb97-5ac64edcae1e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Acquiring lock "cinder-quobyte-b5624304-8033-4627-bb97-5ac64edcae1e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Lock "cinder-quobyte-b5624304-8033-4627-bb97-5ac64edcae1e" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc927dce-2b1b-4ef6-bc78-3868a48a4163]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:44 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9" returned: 0 in 0.509s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:44 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9 Nov 05 17:37:44 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:44 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e Nov 05 17:37:44 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:44 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad.98ea1115-cc67-4be2-b430-c3ca582a03e9" returned: 0 in 0.296s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-98ea1115-cc67-4be2-b430-c3ca582a03e9" released by "_delete_snapshot" :: held 1.875s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-5fc04592-45c9-4a54-9623-a44b068d7dad" released by "delete_snapshot" :: held 1.901s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:45 devstack cinder-volume[87126]: WARNING cinder.quota [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-558275269 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-558275269, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:37:45 devstack cinder-volume[87126]: WARNING cinder.quota [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-558275269 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-558275269, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:37:45 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e" returned: 0 in 0.518s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['11fc4b38-1fc3-4159-a5ab-697ad8d286d5', '2321cfe0-275c-485c-917b-03054573ce68', 'd7f7954b-e507-471a-bf0a-8e08911a6ef2', '939b4f66-418b-4fb2-8e6e-3fcb7eafe74a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:45 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e Nov 05 17:37:45 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-92ae6ef3-b8cf-4c28-934e-73e9935fec28 tempest-GroupSnapshotsTest-1876055469 None] group_snapshot 1dd106e8-c296-4b35-b81d-de48627db3a1: deleted successfully Nov 05 17:37:45 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b5624304-8033-4627-bb97-5ac64edcae1e" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Lock "cinder-quobyte-b5624304-8033-4627-bb97-5ac64edcae1e" released by "delete_volume" :: held 0.891s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Created reservations ['cd4d97fe-dcc1-427e-aca7-3eb64a654055', '033b8dae-ddb9-4432-a72b-b634b21770b6', '6b45a230-f251-492b-8ff3-21baa671f965', 'f3047fd4-8e35-4d42-95b1-e8192e1e37ba'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:45 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:37:45 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "cinder-quobyte-5fc04592-45c9-4a54-9623-a44b068d7dad" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:37:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-5fc04592-45c9-4a54-9623-a44b068d7dad" acquired by "delete_volume" :: waited 0.044s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39de19-5bd7-42ae-b9b8-e843fb6e8505]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:46 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad Nov 05 17:37:46 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:46 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.634s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:37:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Deleted volume successfully. Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3243449b-4ecb-4fd0-9a2a-d87bd0c2ff3e tempest-VolumesServicesTestJSON-1183064479 None] Lock "cinder-b5624304-8033-4627-bb97-5ac64edcae1e-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:46 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d" returned: 0 in 2.495s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_g3upjm0bdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:37:46 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Converted 112.00 MB image at 44.87 MB/s Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:46 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad" returned: 0 in 0.497s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:46 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d 1G Nov 05 17:37:46 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:46 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad Nov 05 17:37:46 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:46 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5fc04592-45c9-4a54-9623-a44b068d7dad" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Lock "cinder-quobyte-5fc04592-45c9-4a54-9623-a44b068d7dad" released by "delete_volume" :: held 0.917s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:37:46 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d 1G" returned: 0 in 0.388s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Downloaded image 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 886a445e-51e1-4beb-8d04-b95b76d20e7d successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a for user 17c595e5775946789c25756c189b637e is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Marking volume 886a445e-51e1-4beb-8d04-b95b76d20e7d as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['4b0434bd-5785-409c-8ba5-d2df69a2d7a9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Copying metadata from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a to 886a445e-51e1-4beb-8d04-b95b76d20e7d. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:37:46 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Creating volume glance metadata for volume 886a445e-51e1-4beb-8d04-b95b76d20e7d backed by image 801ade9d-3bc5-40a6-b715-627da3a7cb0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:37:46 devstack cinder-volume[87126]: WARNING cinder.quota [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-558275269 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-558275269, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Created reservations ['97bc9d43-458c-4a82-980b-347e2a0a4c8a', '838322ef-1892-495a-a68f-0ba92f3cd6cc', 'e78271c8-15c2-42e9-803b-2f4bd4e39729', '09a6f0a8-cb73-43b4-95a9-a756e75d0ed7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0464cc1d-a9f9-4763-b88a-2c18aa3e595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886a445e-51e1-4beb-8d04-b95b76d20e7d', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd3eccb-790f-485d-87fb-ce31f16c09f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:37:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Volume volume-886a445e-51e1-4beb-8d04-b95b76d20e7d (886a445e-51e1-4beb-8d04-b95b76d20e7d): created successfully Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd3eccb-790f-485d-87fb-ce31f16c09f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Flow 'volume_create_manager' (7c24c9c7-0bec-47e0-873e-27efcd189944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:37:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-125decfc-be16-48fc-a6a0-c19aaa809d95 tempest-ServerActionsTestOtherA-596570974 None] Created volume successfully. Nov 05 17:37:47 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:37:47 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:37:47 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:37:47 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:37:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-37868d51-abbc-4ae8-8eec-fcec9e3d0c4c tempest-GroupSnapshotsTest-1876055469 None] Delete group completed successfully. Nov 05 17:37:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-0fc35156-1938-421d-aa6f-cc7843e60e5e req-49bb95df-d333-47a6-a796-354f5e733f2d tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:37:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-0fc35156-1938-421d-aa6f-cc7843e60e5e req-49bb95df-d333-47a6-a796-354f5e733f2d tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:37:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-0fc35156-1938-421d-aa6f-cc7843e60e5e req-49bb95df-d333-47a6-a796-354f5e733f2d tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:37:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-0fc35156-1938-421d-aa6f-cc7843e60e5e req-49bb95df-d333-47a6-a796-354f5e733f2d tempest-ServerActionsTestOtherA-596570974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-886a445e-51e1-4beb-8d04-b95b76d20e7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a67a438f-3a3f-474b-bb4d-2b36af18ae91', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:37:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-0fc35156-1938-421d-aa6f-cc7843e60e5e req-49bb95df-d333-47a6-a796-354f5e733f2d tempest-ServerActionsTestOtherA-596570974 None] attachment_update completed successfully. Nov 05 17:38:02 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=94,cinder:INSERT=29,cinder:UPDATE=77,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:38:02 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:INSERT=25,cinder:UPDATE=101,cinder:SELECT=96,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Flow 'volume_create_manager' (0b142d9c-9951-4d6a-95f0-7c0ccc8660d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075c7076-1123-4234-8663-7775213f84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075c7076-1123-4234-8663-7775213f84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-845202314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e1780a-386e-49d3-8da0-59d232dd09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f4be2296b04a43832a0c273afb530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:04Z,use_quota=True,user_id='278e9c01583740339a8d2ef47ced5f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd9540c-873b-4456-85be-13a818ef0e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd9540c-873b-4456-85be-13a818ef0e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a9ae0c-7555-490e-bc45-ed36cd4e012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a9ae0c-7555-490e-bc45-ed36cd4e012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e1780a-386e-49d3-8da0-59d232dd09b0', 'volume_name': 'volume-e8e1780a-386e-49d3-8da0-59d232dd09b0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575b8922-717c-436c-8d69-df49c999a25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575b8922-717c-436c-8d69-df49c999a25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c66e3f2-a12b-408b-a29a-6feb072a6132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Volume e8e1780a-386e-49d3-8da0-59d232dd09b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e1780a-386e-49d3-8da0-59d232dd09b0', 'volume_size': 1} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-845202314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e1780a-386e-49d3-8da0-59d232dd09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f4be2296b04a43832a0c273afb530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:04Z,use_quota=True,user_id='278e9c01583740339a8d2ef47ced5f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Creating volume e8e1780a-386e-49d3-8da0-59d232dd09b0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:38:03 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:38:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:03 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 1073741824 Nov 05 17:38:03 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:04 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 1073741824" returned: 0 in 0.846s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:04 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 Nov 05 17:38:04 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:05 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0" returned: 0 in 0.343s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:38:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c66e3f2-a12b-408b-a29a-6feb072a6132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e1780a-386e-49d3-8da0-59d232dd09b0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f1f32d-aef8-4fae-82dc-aad43be68f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Volume volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 (e8e1780a-386e-49d3-8da0-59d232dd09b0): created successfully Nov 05 17:38:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f1f32d-aef8-4fae-82dc-aad43be68f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Flow 'volume_create_manager' (0b142d9c-9951-4d6a-95f0-7c0ccc8660d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4870a3cc-d0e6-4dad-9326-7603a731c697 tempest-AttachVolumeShelveTestJSON-222168041 None] Created volume successfully. Nov 05 17:38:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7f126f63-4724-456e-b838-3604db553b6c req-e415581f-3238-43a3-af2c-104a4731f947 tempest-ServerActionsTestOtherA-596570974 None] Terminate volume connection completed successfully. Nov 05 17:38:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-7f126f63-4724-456e-b838-3604db553b6c req-e415581f-3238-43a3-af2c-104a4731f947 tempest-ServerActionsTestOtherA-596570974 None] Deleting attachment a67a438f-3a3f-474b-bb4d-2b36af18ae91. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:38:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7f126f63-4724-456e-b838-3604db553b6c req-aef03067-0293-4108-8f5d-0115292894f5 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7f126f63-4724-456e-b838-3604db553b6c req-aef03067-0293-4108-8f5d-0115292894f5 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7f126f63-4724-456e-b838-3604db553b6c req-aef03067-0293-4108-8f5d-0115292894f5 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-7f126f63-4724-456e-b838-3604db553b6c req-aef03067-0293-4108-8f5d-0115292894f5 tempest-ServerActionsTestOtherA-596570974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-886a445e-51e1-4beb-8d04-b95b76d20e7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e9e335b-f752-4514-8ca1-b866c45bddb7', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:38:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7f126f63-4724-456e-b838-3604db553b6c req-aef03067-0293-4108-8f5d-0115292894f5 tempest-ServerActionsTestOtherA-596570974 None] attachment_update completed successfully. Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Flow 'volume_create_manager' (9af092e4-bfbb-44a1-9d4a-01f6f5ebfd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7608873c-a214-4da1-81e5-25b4e39e1a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7608873c-a214-4da1-81e5-25b4e39e1a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-738401645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d07b873-4eda-4df2-8c9e-e12f6b3e1b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b856bb57be44d08324d8ea5465b3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:13Z,use_quota=True,user_id='a9ae2894654f46699e8a7dc6a74720bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cae40e6-5232-4e24-aa7a-521df89a9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cae40e6-5232-4e24-aa7a-521df89a9b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf8e09f-fa68-49fd-bf00-86383d050a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf8e09f-fa68-49fd-bf00-86383d050a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d07b873-4eda-4df2-8c9e-e12f6b3e1b34', 'volume_name': 'volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6460eed0-e169-4ac4-aa6d-9ec3a015833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6460eed0-e169-4ac4-aa6d-9ec3a015833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428f9b5e-f643-4659-978f-e00ca1b99e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Volume 9d07b873-4eda-4df2-8c9e-e12f6b3e1b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34', 'volume_size': 1} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-738401645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d07b873-4eda-4df2-8c9e-e12f6b3e1b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b856bb57be44d08324d8ea5465b3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:13Z,use_quota=True,user_id='a9ae2894654f46699e8a7dc6a74720bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Creating volume 9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:38:13 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:13 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 1073741824 Nov 05 17:38:13 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:13 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:38:13 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:14 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.687s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:38:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:38:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:38:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:38:14 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 1073741824" returned: 0 in 1.088s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:14 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 Nov 05 17:38:14 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:15 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428f9b5e-f643-4659-978f-e00ca1b99e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf27a1-bd24-4356-845f-d1357e4426a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Volume volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 (9d07b873-4eda-4df2-8c9e-e12f6b3e1b34): created successfully Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf27a1-bd24-4356-845f-d1357e4426a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Flow 'volume_create_manager' (9af092e4-bfbb-44a1-9d4a-01f6f5ebfd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-17d189f0-adc7-4d6a-b67b-b102a01070cf tempest-VolumeQuotasAdminTestJSON-1990017872 None] Created volume successfully. Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Acquiring lock "cinder-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "cinder-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Acquiring lock "cinder-quobyte-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "cinder-quobyte-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d29879-c371-43cd-a475-ce11fb3bf0f8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:38:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:16 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 Nov 05 17:38:16 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:16 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34" returned: 0 in 0.660s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:16 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34 Nov 05 17:38:16 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:17 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "cinder-quobyte-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34" released by "delete_volume" :: held 1.306s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Created reservations ['0991b218-07d5-4611-88f3-b9bf341f6ded', '6e64f87f-0deb-4a3a-af02-d95e472da031', '7fe2a313-c34e-4eed-89a7-eb6765252596', '4097b0b3-ea44-469c-a09f-86082ef049e5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:17 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:38:17 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:18 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.530s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:18 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:38:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Deleted volume successfully. Nov 05 17:38:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-589a7dc3-ed47-42fc-a41d-9df949b127eb tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "cinder-9d07b873-4eda-4df2-8c9e-e12f6b3e1b34-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Flow 'volume_create_manager' (611624fa-5b46-4dbc-9cb5-bdb188b8e24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ff9812-dcc1-4741-b392-e83358f06e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ff9812-dcc1-4741-b392-e83358f06e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1187603866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33188086-b6b3-4ef1-878c-9e37b6084eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b856bb57be44d08324d8ea5465b3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:19Z,use_quota=True,user_id='a9ae2894654f46699e8a7dc6a74720bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f3740-0a31-46df-8bf2-147ad1b0c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f3740-0a31-46df-8bf2-147ad1b0c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7902ba-255a-4dd5-bd28-e46ee0f0872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7902ba-255a-4dd5-bd28-e46ee0f0872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33188086-b6b3-4ef1-878c-9e37b6084eba', 'volume_name': 'volume-33188086-b6b3-4ef1-878c-9e37b6084eba', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1950f504-0afd-4dd4-be79-160820b84fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1950f504-0afd-4dd4-be79-160820b84fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511b0558-d22a-4539-ada6-3a2d2ad79284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Volume 33188086-b6b3-4ef1-878c-9e37b6084eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33188086-b6b3-4ef1-878c-9e37b6084eba', 'volume_size': 1} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1187603866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33188086-b6b3-4ef1-878c-9e37b6084eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b856bb57be44d08324d8ea5465b3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:19Z,use_quota=True,user_id='a9ae2894654f46699e8a7dc6a74720bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Creating volume 33188086-b6b3-4ef1-878c-9e37b6084eba {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:38:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:38:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:19 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba 1073741824 Nov 05 17:38:19 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:20 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba 1073741824" returned: 0 in 1.083s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:20 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba Nov 05 17:38:20 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:21 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511b0558-d22a-4539-ada6-3a2d2ad79284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33188086-b6b3-4ef1-878c-9e37b6084eba', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7849c822-f832-436b-98d0-6a5b0334ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Volume volume-33188086-b6b3-4ef1-878c-9e37b6084eba (33188086-b6b3-4ef1-878c-9e37b6084eba): created successfully Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7849c822-f832-436b-98d0-6a5b0334ef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Flow 'volume_create_manager' (611624fa-5b46-4dbc-9cb5-bdb188b8e24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3a4dbf3b-5378-454c-ad63-a1c0622bb4e5 tempest-VolumeQuotasAdminTestJSON-1990017872 None] Created volume successfully. Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-c5e61a54-4753-4b10-bc1d-2fe90323a502 req-22e61aa9-3530-4e6b-80ee-be31b2e24e7c tempest-AttachVolumeShelveTestJSON-222168041 None] No connector for attachment e5166864-f6e7-4031-814f-7fbaf940fe6f; skipping storage backend terminate_connection call. {{(pid=87126) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 05 17:38:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-c5e61a54-4753-4b10-bc1d-2fe90323a502 req-22e61aa9-3530-4e6b-80ee-be31b2e24e7c tempest-AttachVolumeShelveTestJSON-222168041 None] Deleting attachment e5166864-f6e7-4031-814f-7fbaf940fe6f. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:38:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c4ec275a-5165-418a-a8af-0b73e61d06ae tempest-VolumeQuotasAdminTestJSON-1396259661 None] Transfer volume completed successfully. Nov 05 17:38:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Acquiring lock "cinder-33188086-b6b3-4ef1-878c-9e37b6084eba-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Lock "cinder-33188086-b6b3-4ef1-878c-9e37b6084eba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Acquiring lock "cinder-quobyte-33188086-b6b3-4ef1-878c-9e37b6084eba" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Lock "cinder-quobyte-33188086-b6b3-4ef1-878c-9e37b6084eba" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:23 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b10701-d16c-4689-b6c8-172d281f38b8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:38:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:23 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba Nov 05 17:38:23 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:24 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba" returned: 0 in 0.684s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:24 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba Nov 05 17:38:24 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:24 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-33188086-b6b3-4ef1-878c-9e37b6084eba" returned: 0 in 0.516s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Lock "cinder-quobyte-33188086-b6b3-4ef1-878c-9e37b6084eba" released by "delete_volume" :: held 1.266s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Created reservations ['86c5800a-7833-485f-903d-ab8476da99bd', 'dfaf0ecb-cd26-4152-bb60-f360b9b6a94e', '43580dbb-2b23-4064-9bd4-e933e1b04a52', '45813dcf-24a2-48ff-b42e-23fb5978c808'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:25 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:38:25 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:25 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:38:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Deleted volume successfully. Nov 05 17:38:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fb5ec1d1-7c78-41af-ad7d-9fe2667e184a tempest-VolumeQuotasAdminTestJSON-591150818 None] Lock "cinder-33188086-b6b3-4ef1-878c-9e37b6084eba-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:38:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=25,cinder:INSERT=5,cinder:SELECT=26,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Flow 'volume_create_manager' (1e8f8979-9881-443d-b1f0-f4ee0145908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2b35f-85f9-4058-9fd0-399e49d8761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2b35f-85f9-4058-9fd0-399e49d8761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1951991866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce35aa6-3846-404f-bb97-045b2541229c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddba9ba59284199a84af4003ca205ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:40Z,use_quota=True,user_id='2190ad7e55ee4840928927e23355e8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbd92da-4d65-4555-8a97-940169d550eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbd92da-4d65-4555-8a97-940169d550eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdccdf8-2af7-4db8-afe5-9685e38657eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdccdf8-2af7-4db8-afe5-9685e38657eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce35aa6-3846-404f-bb97-045b2541229c', 'volume_name': 'volume-bce35aa6-3846-404f-bb97-045b2541229c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8eef54-b588-49a7-9d5c-5ff956a2ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8eef54-b588-49a7-9d5c-5ff956a2ae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d682f6b-82e8-4e24-8971-29f77d8a9af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Volume bce35aa6-3846-404f-bb97-045b2541229c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce35aa6-3846-404f-bb97-045b2541229c', 'volume_size': 1} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1951991866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce35aa6-3846-404f-bb97-045b2541229c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddba9ba59284199a84af4003ca205ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:38:40Z,use_quota=True,user_id='2190ad7e55ee4840928927e23355e8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Creating volume bce35aa6-3846-404f-bb97-045b2541229c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:38:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:38:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:40 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c 1073741824 Nov 05 17:38:40 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:41 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c 1073741824" returned: 0 in 0.763s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:41 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c Nov 05 17:38:41 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:41 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d682f6b-82e8-4e24-8971-29f77d8a9af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce35aa6-3846-404f-bb97-045b2541229c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee565a95-087f-4c7f-a705-7deccd4b2a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:38:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Volume volume-bce35aa6-3846-404f-bb97-045b2541229c (bce35aa6-3846-404f-bb97-045b2541229c): created successfully Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee565a95-087f-4c7f-a705-7deccd4b2a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:38:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Flow 'volume_create_manager' (1e8f8979-9881-443d-b1f0-f4ee0145908a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:38:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a384b4f4-469c-49b6-ad82-b2681441ccd2 tempest-VolumeQuotasNegativeTestJSON-258981485 None] Created volume successfully. Nov 05 17:38:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Acquiring lock "cinder-bce35aa6-3846-404f-bb97-045b2541229c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "cinder-bce35aa6-3846-404f-bb97-045b2541229c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Acquiring lock "cinder-quobyte-bce35aa6-3846-404f-bb97-045b2541229c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "cinder-quobyte-bce35aa6-3846-404f-bb97-045b2541229c" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca56b3-342e-461b-90c8-caf66c2d00a5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:38:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:44 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c Nov 05 17:38:44 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:45 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:45 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c Nov 05 17:38:45 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:45 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bce35aa6-3846-404f-bb97-045b2541229c" returned: 0 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "cinder-quobyte-bce35aa6-3846-404f-bb97-045b2541229c" released by "delete_volume" :: held 1.068s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Created reservations ['46f7cfe8-bfba-480a-a6b0-2d45796417c6', '427c26cb-3c3b-49d0-af11-df2fd567480a', 'a71c4643-7171-4ee3-8322-6705ead400f4', '126fe5a9-c237-478e-aad8-5ecad3cc57e7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:45 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:38:45 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:46 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:46 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:38:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Deleted volume successfully. Nov 05 17:38:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1924639-b0fb-43a9-bfea-5776c8787eaf tempest-VolumeQuotasNegativeTestJSON-258981485 None] Lock "cinder-bce35aa6-3846-404f-bb97-045b2541229c-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-45cfa0e1-7f10-418d-9cb0-8f8483ac2329 tempest-ServerActionsTestOtherA-596570974 None] Terminate volume connection completed successfully. Nov 05 17:38:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-45cfa0e1-7f10-418d-9cb0-8f8483ac2329 tempest-ServerActionsTestOtherA-596570974 None] Deleting attachment 3e9e335b-f752-4514-8ca1-b866c45bddb7. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:38:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "cinder-886a445e-51e1-4beb-8d04-b95b76d20e7d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-886a445e-51e1-4beb-8d04-b95b76d20e7d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "cinder-quobyte-886a445e-51e1-4beb-8d04-b95b76d20e7d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-quobyte-886a445e-51e1-4beb-8d04-b95b76d20e7d" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e95ca12-0279-4e27-9bea-cdc7479a02c6]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:38:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:48 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d Nov 05 17:38:48 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:48 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d" returned: 0 in 0.892s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:48 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d Nov 05 17:38:48 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:49 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-886a445e-51e1-4beb-8d04-b95b76d20e7d" returned: 0 in 0.499s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-quobyte-886a445e-51e1-4beb-8d04-b95b76d20e7d" released by "delete_volume" :: held 1.490s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG cinder.quota [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Created reservations ['7ec38ebc-65fd-4bc7-808d-85b7f885f8dd', '433032b3-2124-453c-a59b-6f304b315276', 'fda30860-6133-458d-b580-28a56a575f97', '43417c60-6b5c-4693-8126-f52096a21999'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:49 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:38:49 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:49 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG cinder.manager [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:38:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Deleted volume successfully. Nov 05 17:38:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-a6d41dba-6a03-4a43-8ad3-cfc54e7eb4ab req-0942f61c-f552-4c8f-a5d8-fb48b319ac95 tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-886a445e-51e1-4beb-8d04-b95b76d20e7d-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "cinder-47be8f0a-972f-4390-ac13-e97d49fdc9fc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-47be8f0a-972f-4390-ac13-e97d49fdc9fc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "cinder-quobyte-47be8f0a-972f-4390-ac13-e97d49fdc9fc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-quobyte-47be8f0a-972f-4390-ac13-e97d49fdc9fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a88834-2603-41d8-bf20-095a2dd2ab44]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:50 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc Nov 05 17:38:50 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:50 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc" returned: 0 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:50 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc Nov 05 17:38:50 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:51 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-47be8f0a-972f-4390-ac13-e97d49fdc9fc" returned: 0 in 0.382s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-quobyte-47be8f0a-972f-4390-ac13-e97d49fdc9fc" released by "delete_volume" :: held 0.865s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Created reservations ['6956b754-003e-4e3d-92e8-109a4c72eac9', 'b7711c05-8b94-443d-924f-662ca58dd1a2', '3e55b9d0-3cdd-4598-b18d-b0812496914b', 'bf90cf6e-51e1-4e19-8013-a3cddd3fa658'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:38:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:38:51 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:38:51 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:38:52 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Nov 05 17:38:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.631s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:38:52 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:38:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Deleted volume successfully. Nov 05 17:38:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc892bc3-d033-40aa-a15d-6be38d5213ae tempest-ServerActionsTestOtherA-596570974 None] Lock "cinder-47be8f0a-972f-4390-ac13-e97d49fdc9fc-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (32442411-e442-4ca3-a195-587974291d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90292883-9b4c-4d05-b871-81d963ec4d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90292883-9b4c-4d05-b871-81d963ec4d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1037357524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e0067e-5d55-4ff4-b28b-e732d36c5a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:01Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87868e46-9c25-490a-b789-3370118f6c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87868e46-9c25-490a-b789-3370118f6c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b04206-b9c2-43cf-96a9-f22d8c52c313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b04206-b9c2-43cf-96a9-f22d8c52c313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e0067e-5d55-4ff4-b28b-e732d36c5a48', 'volume_name': 'volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3945ac-27c6-427b-beff-4ea87ad4ead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3945ac-27c6-427b-beff-4ea87ad4ead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b66d3e-a5cd-4253-b5ae-aced0c63fd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Volume 26e0067e-5d55-4ff4-b28b-e732d36c5a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48', 'volume_size': 1} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1037357524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e0067e-5d55-4ff4-b28b-e732d36c5a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:01Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Creating volume 26e0067e-5d55-4ff4-b28b-e732d36c5a48 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:01 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:01 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 1073741824 Nov 05 17:39:01 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:02 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=17,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:39:02 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 1073741824" returned: 0 in 1.084s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:02 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 Nov 05 17:39:02 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:03 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48" returned: 0 in 0.722s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b66d3e-a5cd-4253-b5ae-aced0c63fd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7a808a-2368-472f-8670-2c372e193c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Volume volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 (26e0067e-5d55-4ff4-b28b-e732d36c5a48): created successfully Nov 05 17:39:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7a808a-2368-472f-8670-2c372e193c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (32442411-e442-4ca3-a195-587974291d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-19515ca6-4fb1-49c8-b540-b0e1a2420a94 tempest-VolumesActionsTest-546985907 None] Created volume successfully. Nov 05 17:39:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d9b2644-2dd7-4e42-ac4f-15a37df626ee tempest-VolumesActionsTest-546985907 None] Acquiring lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48" by "attach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d9b2644-2dd7-4e42-ac4f-15a37df626ee tempest-VolumesActionsTest-546985907 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48" acquired by "attach_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2d9b2644-2dd7-4e42-ac4f-15a37df626ee tempest-VolumesActionsTest-546985907 None] Attaching volume 26e0067e-5d55-4ff4-b28b-e732d36c5a48 to instance 46227ad0-2a75-47ba-9b92-8bb595e5da7a at mountpoint /dev/vdb on host None. Nov 05 17:39:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2d9b2644-2dd7-4e42-ac4f-15a37df626ee tempest-VolumesActionsTest-546985907 None] Attach volume completed successfully. Nov 05 17:39:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d9b2644-2dd7-4e42-ac4f-15a37df626ee tempest-VolumesActionsTest-546985907 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48" released by "attach_volume" :: held 0.306s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f1449a6c-856b-4d7d-a1e8-6145f8be0c77 tempest-VolumesActionsTest-1191541843 None] Terminate volume connection completed successfully. Nov 05 17:39:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1449a6c-856b-4d7d-a1e8-6145f8be0c77 tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1449a6c-856b-4d7d-a1e8-6145f8be0c77 tempest-VolumesActionsTest-1191541843 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f1449a6c-856b-4d7d-a1e8-6145f8be0c77 tempest-VolumesActionsTest-1191541843 None] Detaching volume 26e0067e-5d55-4ff4-b28b-e732d36c5a48 from instance 46227ad0-2a75-47ba-9b92-8bb595e5da7a. Nov 05 17:39:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f1449a6c-856b-4d7d-a1e8-6145f8be0c77 tempest-VolumesActionsTest-1191541843 None] Detach volume completed successfully. Nov 05 17:39:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1449a6c-856b-4d7d-a1e8-6145f8be0c77 tempest-VolumesActionsTest-1191541843 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6cc8374b-38f6-43d8-a475-485e92ca7bda tempest-VolumesActionsTest-546985907 None] Acquiring lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6cc8374b-38f6-43d8-a475-485e92ca7bda tempest-VolumesActionsTest-546985907 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6cc8374b-38f6-43d8-a475-485e92ca7bda tempest-VolumesActionsTest-546985907 None] Volume detach called, but volume not attached. Nov 05 17:39:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6cc8374b-38f6-43d8-a475-485e92ca7bda tempest-VolumesActionsTest-546985907 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Acquiring lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Acquiring lock "cinder-quobyte-26e0067e-5d55-4ff4-b28b-e732d36c5a48" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Lock "cinder-quobyte-26e0067e-5d55-4ff4-b28b-e732d36c5a48" acquired by "delete_volume" :: waited 0.051s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ada7a-a1a0-4706-9253-6afd92e5fd4f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:08 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 Nov 05 17:39:08 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:08 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48" returned: 0 in 0.515s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:08 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48 Nov 05 17:39:08 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Acquiring lock "cinder-e8e1780a-386e-49d3-8da0-59d232dd09b0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "cinder-e8e1780a-386e-49d3-8da0-59d232dd09b0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Acquiring lock "cinder-quobyte-e8e1780a-386e-49d3-8da0-59d232dd09b0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "cinder-quobyte-e8e1780a-386e-49d3-8da0-59d232dd09b0" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d6ae39-0947-4406-91f9-0335b57878cc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:09 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-26e0067e-5d55-4ff4-b28b-e732d36c5a48" returned: 0 in 0.528s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Lock "cinder-quobyte-26e0067e-5d55-4ff4-b28b-e732d36c5a48" released by "delete_volume" :: held 1.127s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Created reservations ['18605faa-8d2b-4397-af52-bc32fa46a3ad', '9c8e88d7-c70a-40f4-a3ac-2fa1d075dd62', '5d9340d1-ec38-4907-9164-59bf17c01a51', 'c2c3ba61-d87f-4151-bec3-d45484d855b3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:09 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 Nov 05 17:39:09 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:09 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:09 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:09 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Deleted volume successfully. Nov 05 17:39:09 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0" returned: 0 in 0.770s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bdb21277-3344-490f-8da3-6b0509eced6c tempest-VolumesActionsTest-546985907 None] Lock "cinder-26e0067e-5d55-4ff4-b28b-e732d36c5a48-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:10 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0 Nov 05 17:39:10 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:10 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e8e1780a-386e-49d3-8da0-59d232dd09b0" returned: 0 in 0.378s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "cinder-quobyte-e8e1780a-386e-49d3-8da0-59d232dd09b0" released by "delete_volume" :: held 1.236s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Created reservations ['d818c2e5-b3af-48b7-a76f-f91eb3a1a147', 'd510f72e-5dea-4d83-950f-77e46c6fe5e6', '7a2d5978-3405-423b-bef4-9346e28a9e89', 'a9c6b320-02e5-4982-aa4e-e4711678725d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:10 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:10 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:11 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:11 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Deleted volume successfully. Nov 05 17:39:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32ff10ff-7ed0-43ca-b76c-087b131cb1fd tempest-AttachVolumeShelveTestJSON-222168041 None] Lock "cinder-e8e1780a-386e-49d3-8da0-59d232dd09b0-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:39:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:13 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:13 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:14 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:39:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:39:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (7982fd1f-c1dc-451a-b620-484a93a11f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e26cb6-c8b6-4cba-b422-23b70e46b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e26cb6-c8b6-4cba-b422-23b70e46b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899710971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae16b0e3-2e51-4ab1-8613-8251bade42f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:15Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd2c85a-dda7-4e82-80ee-38bd567442ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd2c85a-dda7-4e82-80ee-38bd567442ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61e9d15-b36c-4d66-8c0b-b72e3f9f4361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61e9d15-b36c-4d66-8c0b-b72e3f9f4361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae16b0e3-2e51-4ab1-8613-8251bade42f4', 'volume_name': 'volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e89038a-10c1-4a39-b3df-77a620adb7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e89038a-10c1-4a39-b3df-77a620adb7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd43041-263a-4055-996d-977de76f6d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Volume ae16b0e3-2e51-4ab1-8613-8251bade42f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4', 'volume_size': 1} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899710971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae16b0e3-2e51-4ab1-8613-8251bade42f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:15Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Creating volume ae16b0e3-2e51-4ab1-8613-8251bade42f4 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:15 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:15 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 1073741824 Nov 05 17:39:15 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Flow 'volume_create_manager' (ba513e76-732b-4826-a31b-ee8203bffadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8ca649-5c3c-4ac8-8fd6-3766adcacb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8ca649-5c3c-4ac8-8fd6-3766adcacb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1262071790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e741bd0-8c22-4e6a-bc50-cb5866349a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf51c08ee684f3dbb07787a4689e326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:15Z,use_quota=True,user_id='ea9c903ead9a49598a18bd979a9fe004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd3e5a9-bfd6-4c6e-bd67-245cab534997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd3e5a9-bfd6-4c6e-bd67-245cab534997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5227b0a8-26b8-4994-a4ca-c4c4e77b680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5227b0a8-26b8-4994-a4ca-c4c4e77b680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e741bd0-8c22-4e6a-bc50-cb5866349a8c', 'volume_name': 'volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6567803f-218f-4aa8-be68-4ae8212867d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6567803f-218f-4aa8-be68-4ae8212867d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312f3142-b5ed-486c-bda9-84a6100c5930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Volume 6e741bd0-8c22-4e6a-bc50-cb5866349a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c', 'volume_size': 1} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:15 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 1073741824" returned: 0 in 0.555s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:15 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 Nov 05 17:39:15 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:16 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1262071790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e741bd0-8c22-4e6a-bc50-cb5866349a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf51c08ee684f3dbb07787a4689e326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:15Z,use_quota=True,user_id='ea9c903ead9a49598a18bd979a9fe004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Creating volume 6e741bd0-8c22-4e6a-bc50-cb5866349a8c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd43041-263a-4055-996d-977de76f6d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5f486a-cf1b-4145-860e-cf0f086fabfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:16 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c 1073741824 Nov 05 17:39:16 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Volume volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 (ae16b0e3-2e51-4ab1-8613-8251bade42f4): created successfully Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5f486a-cf1b-4145-860e-cf0f086fabfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (7982fd1f-c1dc-451a-b620-484a93a11f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-479bae7c-17b8-4b4d-a631-fd4024dfb087 tempest-VolumesActionsTest-546985907 None] Created volume successfully. Nov 05 17:39:16 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c 1073741824" returned: 0 in 0.606s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:16 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c Nov 05 17:39:16 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:17 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312f3142-b5ed-486c-bda9-84a6100c5930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fd081c-41ec-446a-a761-8a93a3170039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Volume volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c (6e741bd0-8c22-4e6a-bc50-cb5866349a8c): created successfully Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fd081c-41ec-446a-a761-8a93a3170039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Flow 'volume_create_manager' (ba513e76-732b-4826-a31b-ee8203bffadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-db5b3e4a-7949-4719-95c3-51a22bbb3266 tempest-VolumesTransfersTest-140775293 None] Created volume successfully. Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-ae16b0e3-2e51-4ab1-8613-8251bade42f4-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Lock "cinder-ae16b0e3-2e51-4ab1-8613-8251bade42f4-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-quobyte-ae16b0e3-2e51-4ab1-8613-8251bade42f4" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-ae16b0e3-2e51-4ab1-8613-8251bade42f4" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ad77bc-0f42-4c56-926b-7ca9d026a3ca]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:17 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 Nov 05 17:39:17 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:18 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4" returned: 0 in 0.477s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:18 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4 Nov 05 17:39:18 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:18 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ae16b0e3-2e51-4ab1-8613-8251bade42f4" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-ae16b0e3-2e51-4ab1-8613-8251bade42f4" released by "delete_volume" :: held 0.897s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Created reservations ['699c6680-5b25-4a2c-a188-91ac94d1b247', 'd12e2247-76b4-4d38-a01e-0693e881cb02', 'e812aad2-0d17-4bae-80fe-46339f8feff3', 'bf9b9852-b576-452f-9f64-2664725ff63c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:18 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:18 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7d386baf-6f17-4102-a730-3059afd76d73 tempest-VolumesTransfersTest-235118240 None] Transfer volume completed successfully. Nov 05 17:39:19 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.505s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Deleted volume successfully. Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cfed1e51-3c03-4010-ba08-7a13c01dbf5b tempest-VolumesActionsTest-1191541843 None] Lock "cinder-ae16b0e3-2e51-4ab1-8613-8251bade42f4-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (775c1247-670d-48a4-8d91-76dc082a4fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81396a68-c354-4346-bc5f-ee9595b6b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81396a68-c354-4346-bc5f-ee9595b6b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1373462071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4130e7-51c6-4847-b145-4b84068d17f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:19Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe725ce-a09e-4e51-b7ec-46f1e2a72786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe725ce-a09e-4e51-b7ec-46f1e2a72786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2ffdc1-3fff-44f9-8e83-5d9470d28f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2ffdc1-3fff-44f9-8e83-5d9470d28f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4130e7-51c6-4847-b145-4b84068d17f5', 'volume_name': 'volume-9f4130e7-51c6-4847-b145-4b84068d17f5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eda309-d22b-4dec-a24f-507aeae327cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eda309-d22b-4dec-a24f-507aeae327cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e175b9a3-949a-4ee4-ba74-1d58eec97211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Volume 9f4130e7-51c6-4847-b145-4b84068d17f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4130e7-51c6-4847-b145-4b84068d17f5', 'volume_size': 1} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1373462071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4130e7-51c6-4847-b145-4b84068d17f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:19Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Creating volume 9f4130e7-51c6-4847-b145-4b84068d17f5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:19 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 1073741824 Nov 05 17:39:19 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Acquiring lock "cinder-6e741bd0-8c22-4e6a-bc50-cb5866349a8c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-6e741bd0-8c22-4e6a-bc50-cb5866349a8c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Acquiring lock "cinder-quobyte-6e741bd0-8c22-4e6a-bc50-cb5866349a8c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-quobyte-6e741bd0-8c22-4e6a-bc50-cb5866349a8c" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[34539549-bd82-4b5f-8f78-d05ee25fc1f4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:20 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:20 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 1073741824" returned: 0 in 0.651s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:20 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:20 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 Nov 05 17:39:20 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:20 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:20 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c Nov 05 17:39:20 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:20 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5" returned: 0 in 0.499s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e175b9a3-949a-4ee4-ba74-1d58eec97211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4130e7-51c6-4847-b145-4b84068d17f5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e2b927-a624-4b35-9e41-a66894088fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Volume volume-9f4130e7-51c6-4847-b145-4b84068d17f5 (9f4130e7-51c6-4847-b145-4b84068d17f5): created successfully Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e2b927-a624-4b35-9e41-a66894088fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (775c1247-670d-48a4-8d91-76dc082a4fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4463e710-232c-4093-b2a9-f8e9f0de2ac0 tempest-VolumesActionsTest-546985907 None] Created volume successfully. Nov 05 17:39:21 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6e741bd0-8c22-4e6a-bc50-cb5866349a8c" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-quobyte-6e741bd0-8c22-4e6a-bc50-cb5866349a8c" released by "delete_volume" :: held 0.974s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Created reservations ['68c3da09-3613-4b1e-a9d2-cea4ba5ced98', '8e89e458-6ce5-4aeb-9304-1e5ccad766fa', '4d9bb5d6-9a22-41e7-b95a-87340a4f0818', '62815506-4eb1-4489-a99b-062d70f2f5cd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:21 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:21 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:21 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Deleted volume successfully. Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-572887db-5d49-4687-93d7-073c7a145500 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-6e741bd0-8c22-4e6a-bc50-cb5866349a8c-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-9f4130e7-51c6-4847-b145-4b84068d17f5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Lock "cinder-9f4130e7-51c6-4847-b145-4b84068d17f5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-quobyte-9f4130e7-51c6-4847-b145-4b84068d17f5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-9f4130e7-51c6-4847-b145-4b84068d17f5" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[15763168-bc51-421a-876f-bfe2e786b847]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Flow 'volume_create_manager' (be295a3d-9084-494c-9ff0-3e43b04c5ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fc6422-c721-41d2-bb85-fea8340e0114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:22 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 Nov 05 17:39:22 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fc6422-c721-41d2-bb85-fea8340e0114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-733757589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd21edf-1f6c-497b-986f-9cc5270f8b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf51c08ee684f3dbb07787a4689e326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:22Z,use_quota=True,user_id='ea9c903ead9a49598a18bd979a9fe004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759ed68f-71da-44c0-9dce-285426c3b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759ed68f-71da-44c0-9dce-285426c3b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb33ca6b-e95e-4ee1-a0ee-9a886ccbc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb33ca6b-e95e-4ee1-a0ee-9a886ccbc301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd21edf-1f6c-497b-986f-9cc5270f8b46', 'volume_name': 'volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6278566f-66b1-4d73-8c3b-a293ebcae948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6278566f-66b1-4d73-8c3b-a293ebcae948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2170f1b8-de0d-4cd5-b9b8-d64e442b8549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Volume cfd21edf-1f6c-497b-986f-9cc5270f8b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46', 'volume_size': 1} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-733757589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd21edf-1f6c-497b-986f-9cc5270f8b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf51c08ee684f3dbb07787a4689e326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:22Z,use_quota=True,user_id='ea9c903ead9a49598a18bd979a9fe004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Creating volume cfd21edf-1f6c-497b-986f-9cc5270f8b46 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:22 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:22 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 1073741824 Nov 05 17:39:22 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:22 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5" returned: 0 in 0.466s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:22 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5 Nov 05 17:39:22 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:22 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f4130e7-51c6-4847-b145-4b84068d17f5" returned: 0 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:23 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-9f4130e7-51c6-4847-b145-4b84068d17f5" released by "delete_volume" :: held 0.930s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 1073741824" returned: 0 in 0.649s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:23 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 Nov 05 17:39:23 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Created reservations ['104f42ff-c77a-469f-b9fb-2bf351abd949', '314a82e6-3dc0-48a0-92ff-a3bd7bd494f0', '7ae5d309-b9a0-49d4-8e52-945c17973ea6', '2f81f9e0-ffed-4ddf-8390-bc7337720dc5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:23 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:23 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:23 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2170f1b8-de0d-4cd5-b9b8-d64e442b8549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da9346d-dec6-4442-9ea6-c27ca1072aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Volume volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 (cfd21edf-1f6c-497b-986f-9cc5270f8b46): created successfully Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da9346d-dec6-4442-9ea6-c27ca1072aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Flow 'volume_create_manager' (be295a3d-9084-494c-9ff0-3e43b04c5ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2c670c3d-640a-4e87-8d54-af6f5df61524 tempest-VolumesTransfersTest-140775293 None] Created volume successfully. Nov 05 17:39:23 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Deleted volume successfully. Nov 05 17:39:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5ff057d-f1b5-4274-9e05-15a867a8f56a tempest-VolumesActionsTest-1191541843 None] Lock "cinder-9f4130e7-51c6-4847-b145-4b84068d17f5-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Acquiring lock "cinder-cfd21edf-1f6c-497b-986f-9cc5270f8b46-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-cfd21edf-1f6c-497b-986f-9cc5270f8b46-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Acquiring lock "cinder-quobyte-cfd21edf-1f6c-497b-986f-9cc5270f8b46" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-quobyte-cfd21edf-1f6c-497b-986f-9cc5270f8b46" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee5718-7640-47c0-88c2-6ca181d22b5a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:25 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 Nov 05 17:39:25 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (6e303b17-b36a-4045-a497-94c93efa4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03613235-ac4e-496a-bec1-136a8272e209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03613235-ac4e-496a-bec1-136a8272e209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380610605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ea8781-b79d-4baa-bf42-ba189f709431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:25Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54996b39-6414-4561-8534-cba598c83bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54996b39-6414-4561-8534-cba598c83bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0271b83-9e6a-4c17-8819-9bf895d4a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0271b83-9e6a-4c17-8819-9bf895d4a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ea8781-b79d-4baa-bf42-ba189f709431', 'volume_name': 'volume-16ea8781-b79d-4baa-bf42-ba189f709431', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a24e71-168c-4992-bce1-14d0f73e4960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a24e71-168c-4992-bce1-14d0f73e4960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eb5b59-2999-42ea-a1a5-2ab9c9f503e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Volume 16ea8781-b79d-4baa-bf42-ba189f709431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ea8781-b79d-4baa-bf42-ba189f709431', 'volume_size': 1} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380610605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ea8781-b79d-4baa-bf42-ba189f709431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:25Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Creating volume 16ea8781-b79d-4baa-bf42-ba189f709431 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:25 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:25 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 1073741824 Nov 05 17:39:25 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:25 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:25 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46 Nov 05 17:39:25 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:25 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cfd21edf-1f6c-497b-986f-9cc5270f8b46" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-quobyte-cfd21edf-1f6c-497b-986f-9cc5270f8b46" released by "delete_volume" :: held 0.941s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Created reservations ['545afe67-95bb-48d4-84c9-ba2f9c12fabe', '62b8cafd-5564-44e9-be94-02bfd794f075', '3840135c-e209-49bf-bb40-d08356cee39c', 'd9625eb6-06ad-4b69-9159-d506bb2d0b08'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:25 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 1073741824" returned: 0 in 0.637s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:25 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 Nov 05 17:39:25 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:26 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:26 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:26 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Deleted volume successfully. Nov 05 17:39:26 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431" returned: 0 in 0.453s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eb5b59-2999-42ea-a1a5-2ab9c9f503e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ea8781-b79d-4baa-bf42-ba189f709431', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163b0b8c-4098-453e-b9b1-970766b8166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-94a71ce6-3e4c-49c6-af57-d37dfd0bd498 tempest-VolumesTransfersTest-808274757 None] Lock "cinder-cfd21edf-1f6c-497b-986f-9cc5270f8b46-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Volume volume-16ea8781-b79d-4baa-bf42-ba189f709431 (16ea8781-b79d-4baa-bf42-ba189f709431): created successfully Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163b0b8c-4098-453e-b9b1-970766b8166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (6e303b17-b36a-4045-a497-94c93efa4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-816407dd-a2e2-4baa-af4a-77e9b7660e55 tempest-VolumesActionsTest-546985907 None] Created volume successfully. Nov 05 17:39:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-16ea8781-b79d-4baa-bf42-ba189f709431-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Lock "cinder-16ea8781-b79d-4baa-bf42-ba189f709431-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-quobyte-16ea8781-b79d-4baa-bf42-ba189f709431" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-16ea8781-b79d-4baa-bf42-ba189f709431" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfaed54-b2d8-4c18-8a12-4727740aae05]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:27 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 Nov 05 17:39:27 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:28 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431" returned: 0 in 0.564s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:28 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431 Nov 05 17:39:28 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:28 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16ea8781-b79d-4baa-bf42-ba189f709431" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-16ea8781-b79d-4baa-bf42-ba189f709431" released by "delete_volume" :: held 1.057s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:28 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Created reservations ['f689aba7-c6a9-4c71-a24c-c6f2cd60893d', '301b20f5-0866-4491-9f15-e0d931e4b84a', '23a4f66a-51f5-4dcc-8e52-d4c249e945f6', 'c9cdeedd-e2c5-4717-bf6b-ea511a13fd0e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:29 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:29 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:29 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.515s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Deleted volume successfully. Nov 05 17:39:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c894f518-9493-4474-9091-d812298670ae tempest-VolumesActionsTest-1191541843 None] Lock "cinder-16ea8781-b79d-4baa-bf42-ba189f709431-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (6417113e-50b8-4e69-9e24-3dc1bdf92394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8ba2da-54cf-4bf1-bdac-dff6751d75a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8ba2da-54cf-4bf1-bdac-dff6751d75a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026260119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d580f67-bb0c-4c72-9449-17f8d8f314f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:31Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4434b43c-b0d6-4d83-b534-508bfd31fbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4434b43c-b0d6-4d83-b534-508bfd31fbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8578d5-e8f8-4d90-845c-0d59bad57f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8578d5-e8f8-4d90-845c-0d59bad57f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d580f67-bb0c-4c72-9449-17f8d8f314f0', 'volume_name': 'volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0029ff30-3892-4a75-9005-c19e28c53715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0029ff30-3892-4a75-9005-c19e28c53715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8b5276-8437-42ff-81bd-4c7a3f67f5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Volume 4d580f67-bb0c-4c72-9449-17f8d8f314f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0', 'volume_size': 1} Nov 05 17:39:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026260119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d580f67-bb0c-4c72-9449-17f8d8f314f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:31Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Creating volume 4d580f67-bb0c-4c72-9449-17f8d8f314f0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:31 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:31 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 1073741824 Nov 05 17:39:31 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:31 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 1073741824" returned: 0 in 0.728s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:31 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 Nov 05 17:39:31 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:32 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8b5276-8437-42ff-81bd-4c7a3f67f5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fd3caf-35e5-41b5-adc7-4d46371d20c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Volume volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 (4d580f67-bb0c-4c72-9449-17f8d8f314f0): created successfully Nov 05 17:39:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fd3caf-35e5-41b5-adc7-4d46371d20c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (6417113e-50b8-4e69-9e24-3dc1bdf92394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-972be20f-da9f-46b2-9b43-ad81041637ad tempest-VolumesActionsTest-546985907 None] Created volume successfully. Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-4d580f67-bb0c-4c72-9449-17f8d8f314f0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Lock "cinder-4d580f67-bb0c-4c72-9449-17f8d8f314f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Acquiring lock "cinder-quobyte-4d580f67-bb0c-4c72-9449-17f8d8f314f0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-4d580f67-bb0c-4c72-9449-17f8d8f314f0" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[198a43d6-53c3-467c-9787-7048450cc864]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:33 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 Nov 05 17:39:33 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:33 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0" returned: 0 in 0.512s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:33 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0 Nov 05 17:39:33 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:34 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4d580f67-bb0c-4c72-9449-17f8d8f314f0" returned: 0 in 0.470s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Lock "cinder-quobyte-4d580f67-bb0c-4c72-9449-17f8d8f314f0" released by "delete_volume" :: held 1.041s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Created reservations ['7d79637a-11d8-4894-a7bb-46f72fc0c14c', '27927c10-0292-481e-8f81-18731e792177', '9d59c494-80f9-4785-bd4f-13556b64eb83', '05c4078c-8bb2-45aa-885e-68fbaf1dc6a8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:34 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:34 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:34 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Deleted volume successfully. Nov 05 17:39:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-637ad752-8b46-4933-bbea-29d4cf02ff07 tempest-VolumesActionsTest-1191541843 None] Lock "cinder-4d580f67-bb0c-4c72-9449-17f8d8f314f0-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=116,cinder:SELECT=82,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (1c90aa68-7a03-450c-8d6f-b20cf8a5702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a0d52a-4596-4f5d-a03e-38fbca15c6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a0d52a-4596-4f5d-a03e-38fbca15c6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29677730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843b9d45-c943-41b2-ae8c-e937b65d82c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:36Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ac3393-c554-4ee6-9ab2-d1feabcbb49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ac3393-c554-4ee6-9ab2-d1feabcbb49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2598f401-f91b-4d6e-bba7-c08c6815dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2598f401-f91b-4d6e-bba7-c08c6815dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843b9d45-c943-41b2-ae8c-e937b65d82c7', 'volume_name': 'volume-843b9d45-c943-41b2-ae8c-e937b65d82c7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e298501-09d1-4ee2-bca8-a115414f964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e298501-09d1-4ee2-bca8-a115414f964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92646c-76cf-4aee-86dc-20bf09df602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Volume 843b9d45-c943-41b2-ae8c-e937b65d82c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843b9d45-c943-41b2-ae8c-e937b65d82c7', 'volume_size': 1} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29677730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843b9d45-c943-41b2-ae8c-e937b65d82c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a310b516d8046af8dafb1039dbaddbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:36Z,use_quota=True,user_id='9bebd534435f4fc7a282e9ccf470fbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Creating volume 843b9d45-c943-41b2-ae8c-e937b65d82c7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:36 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 1073741824 Nov 05 17:39:36 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:36 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 1073741824" returned: 0 in 0.470s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:37 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 Nov 05 17:39:37 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:37 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92646c-76cf-4aee-86dc-20bf09df602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843b9d45-c943-41b2-ae8c-e937b65d82c7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d28c6de-e649-405d-b67a-c3466c3d5d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Volume volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 (843b9d45-c943-41b2-ae8c-e937b65d82c7): created successfully Nov 05 17:39:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d28c6de-e649-405d-b67a-c3466c3d5d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Flow 'volume_create_manager' (1c90aa68-7a03-450c-8d6f-b20cf8a5702a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c2257acc-8f36-472d-8973-7911e315cbe9 tempest-VolumesActionsTest-546985907 None] Created volume successfully. Nov 05 17:39:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Acquiring lock "cinder-843b9d45-c943-41b2-ae8c-e937b65d82c7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Lock "cinder-843b9d45-c943-41b2-ae8c-e937b65d82c7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Acquiring lock "cinder-quobyte-843b9d45-c943-41b2-ae8c-e937b65d82c7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Lock "cinder-quobyte-843b9d45-c943-41b2-ae8c-e937b65d82c7" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e04eb2e-5eea-490a-9737-0ff8d62c5888]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:39 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 Nov 05 17:39:39 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:40 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7" returned: 0 in 1.124s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:40 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7 Nov 05 17:39:40 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:41 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-843b9d45-c943-41b2-ae8c-e937b65d82c7" returned: 0 in 0.866s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Lock "cinder-quobyte-843b9d45-c943-41b2-ae8c-e937b65d82c7" released by "delete_volume" :: held 2.108s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Created reservations ['e1c4ed13-43e0-45ee-932d-ffc95c072c1d', '94d1bfc0-c1a9-46c0-9c5b-4c2485082a67', 'c6967f08-79cf-497e-9114-663119a5b48a', '2bd10f79-6f28-4b95-a93a-26040342abd0'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:41 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:41 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:42 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:42 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Deleted volume successfully. Nov 05 17:39:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-01f61bea-cf57-4b50-b8ef-9f956148e1ea tempest-VolumesActionsTest-546985907 None] Lock "cinder-843b9d45-c943-41b2-ae8c-e937b65d82c7-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (2dbf009e-d59a-426d-bdfa-030ad4242a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514f255e-7a57-442a-856a-d58941120f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514f255e-7a57-442a-856a-d58941120f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2078074424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db0f278-264a-4025-b8b9-4b01741e62b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:45Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff3d6c5-5db1-452d-b6f7-d433eeda4e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff3d6c5-5db1-452d-b6f7-d433eeda4e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904da2b6-eb99-4040-82d9-6db9a5519a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904da2b6-eb99-4040-82d9-6db9a5519a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db0f278-264a-4025-b8b9-4b01741e62b4', 'volume_name': 'volume-5db0f278-264a-4025-b8b9-4b01741e62b4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383b2f58-d0f3-4a5f-b914-3a6a7e095e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383b2f58-d0f3-4a5f-b914-3a6a7e095e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8271981d-d260-4141-91b2-0f8a287f0943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Volume 5db0f278-264a-4025-b8b9-4b01741e62b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db0f278-264a-4025-b8b9-4b01741e62b4', 'volume_size': 1} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2078074424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db0f278-264a-4025-b8b9-4b01741e62b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:45Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Creating volume 5db0f278-264a-4025-b8b9-4b01741e62b4 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:45 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:45 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 1073741824 Nov 05 17:39:45 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:46 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 1073741824" returned: 0 in 1.072s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:46 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 Nov 05 17:39:46 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:47 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4" returned: 0 in 0.634s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8271981d-d260-4141-91b2-0f8a287f0943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db0f278-264a-4025-b8b9-4b01741e62b4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de01bcd3-f0c7-4861-8cce-8547b51e101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Volume volume-5db0f278-264a-4025-b8b9-4b01741e62b4 (5db0f278-264a-4025-b8b9-4b01741e62b4): created successfully Nov 05 17:39:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de01bcd3-f0c7-4861-8cce-8547b51e101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (2dbf009e-d59a-426d-bdfa-030ad4242a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8f90d341-f040-4fd7-b2db-1e0c7ef2c964 tempest-VolumesGetTest-1285063864 None] Created volume successfully. Nov 05 17:39:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:39:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (433d8048-5b67-40b9-9586-60838214d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c304081f-f23e-472a-b438-a59b2b0f086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c304081f-f23e-472a-b438-a59b2b0f086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-714854419',display_name='tempest-VolumesGetTest-Volume-1076208589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb93dcd5-2036-4494-82d5-8d1999cd8d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:51Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f47706e-4653-4f43-8d4b-67e22744639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f47706e-4653-4f43-8d4b-67e22744639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6bb65c-8647-4a1e-ad67-683485c27552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6bb65c-8647-4a1e-ad67-683485c27552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb93dcd5-2036-4494-82d5-8d1999cd8d04', 'volume_name': 'volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7397204e-ffca-4757-a4a4-c3ca7320ac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7397204e-ffca-4757-a4a4-c3ca7320ac03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa798aa6-b311-4a01-8428-da24cbbf5bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Volume cb93dcd5-2036-4494-82d5-8d1999cd8d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04', 'volume_size': 1} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:39:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-714854419',display_name='tempest-VolumesGetTest-Volume-1076208589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb93dcd5-2036-4494-82d5-8d1999cd8d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:39:51Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Creating volume cb93dcd5-2036-4494-82d5-8d1999cd8d04 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:39:51 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:39:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:51 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 1073741824 Nov 05 17:39:51 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:52 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 1073741824" returned: 0 in 1.081s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:52 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 Nov 05 17:39:52 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:52 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04" returned: 0 in 0.532s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa798aa6-b311-4a01-8428-da24cbbf5bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e3952f-5ada-4bcf-a4b2-5f7b6697cdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:39:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Volume volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 (cb93dcd5-2036-4494-82d5-8d1999cd8d04): created successfully Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e3952f-5ada-4bcf-a4b2-5f7b6697cdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:39:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (433d8048-5b67-40b9-9586-60838214d539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:39:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-42b564ea-ac2f-4910-9fca-e058d33b793a tempest-VolumesGetTest-1285063864 None] Created volume successfully. Nov 05 17:39:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-cb93dcd5-2036-4494-82d5-8d1999cd8d04-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Lock "cinder-cb93dcd5-2036-4494-82d5-8d1999cd8d04-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-cb93dcd5-2036-4494-82d5-8d1999cd8d04" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-cb93dcd5-2036-4494-82d5-8d1999cd8d04" acquired by "delete_volume" :: waited 0.068s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e021705a-8364-4ff1-b027-e81fd154b156]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:55 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 Nov 05 17:39:55 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:55 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04" returned: 0 in 0.846s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:55 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04 Nov 05 17:39:55 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:56 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cb93dcd5-2036-4494-82d5-8d1999cd8d04" returned: 0 in 0.802s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-cb93dcd5-2036-4494-82d5-8d1999cd8d04" released by "delete_volume" :: held 1.768s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Created reservations ['455a4b03-6425-4158-8cad-bd8a279c6340', '38bdf025-1b84-4050-8c9a-ab1f2f8e1e26', '3da5d92a-8abb-4e50-82f2-c89685374f45', '8647406c-3ca8-4e6c-8aa9-456375685fb8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:56 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:39:56 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-5db0f278-264a-4025-b8b9-4b01741e62b4-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Lock "cinder-5db0f278-264a-4025-b8b9-4b01741e62b4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:57 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.941s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:39:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Deleted volume successfully. Nov 05 17:39:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-5db0f278-264a-4025-b8b9-4b01741e62b4" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:39:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f23734-8b68-4fc1-ba67-4cd6c2f303aa tempest-VolumesGetTest-1285063864 None] Lock "cinder-cb93dcd5-2036-4494-82d5-8d1999cd8d04-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-5db0f278-264a-4025-b8b9-4b01741e62b4" acquired by "delete_volume" :: waited 0.069s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:39:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad767ecb-08cd-4f8a-8aca-3b34615a9ff5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:39:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:58 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 Nov 05 17:39:58 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:58 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4" returned: 0 in 0.812s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:39:59 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4 Nov 05 17:39:59 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:39:59 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5db0f278-264a-4025-b8b9-4b01741e62b4" returned: 0 in 0.476s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-5db0f278-264a-4025-b8b9-4b01741e62b4" released by "delete_volume" :: held 1.504s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Created reservations ['74c35e5a-9d51-4e3c-aa4f-a72c6198df51', '5354ab43-52a2-48fe-b722-30b8755a90dd', '0ab6fcb4-2768-49bd-b3e1-160647b5fdbf', '677766cf-10c2-4828-821a-7756e1b240c9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:39:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:00 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:00 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:00 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.719s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:00 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Deleted volume successfully. Nov 05 17:40:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-41928d30-2e1b-41e9-9c30-cdce482d2f66 tempest-VolumesGetTest-1285063864 None] Lock "cinder-5db0f278-264a-4025-b8b9-4b01741e62b4-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (37b01105-fd8a-4ba7-8a00-38ccb877faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fadef08-e253-4555-806f-9e8bfedbfde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fadef08-e253-4555-806f-9e8bfedbfde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-816593911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790956e2-cb54-474e-8e47-7a0bd2c76745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:01Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79da5d97-28e0-4180-81dd-95abffae0707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79da5d97-28e0-4180-81dd-95abffae0707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c7de9-8bec-4624-856d-77f68a6df545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c7de9-8bec-4624-856d-77f68a6df545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790956e2-cb54-474e-8e47-7a0bd2c76745', 'volume_name': 'volume-790956e2-cb54-474e-8e47-7a0bd2c76745', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3918a3-fdc1-4b0a-8d60-7f0b3beb28cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3918a3-fdc1-4b0a-8d60-7f0b3beb28cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff56d90a-7638-41cd-aecd-7e9fdbb78968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Volume 790956e2-cb54-474e-8e47-7a0bd2c76745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790956e2-cb54-474e-8e47-7a0bd2c76745', 'volume_size': 1} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-816593911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790956e2-cb54-474e-8e47-7a0bd2c76745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:01Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Creating volume 790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:01 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:02 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 1073741824 Nov 05 17:40:02 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=83,cinder:UPDATE=122,cinder:DELETE=14,cinder:INSERT=29 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Flow 'volume_create_manager' (194756fe-1647-4ae0-8f44-834f50e20c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990c6c6b-52ad-49c0-b4eb-87c6f22df1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990c6c6b-52ad-49c0-b4eb-87c6f22df1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2029511446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7dbbb2d1004268b15a01d4ff20a06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:02Z,use_quota=True,user_id='20a19e4227bb44c3aa6f7ad5b82ad978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72894360-bf73-4d03-bbeb-9ed6bacb2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72894360-bf73-4d03-bbeb-9ed6bacb2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc0bbfd-034e-4f69-8c89-b9e3d8429aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc0bbfd-034e-4f69-8c89-b9e3d8429aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c', 'volume_name': 'volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d137ab30-0a0c-43ac-b6ee-b51d02c8ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d137ab30-0a0c-43ac-b6ee-b51d02c8ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce9c276-0ea3-4763-a913-cc2e8b1d034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Volume 5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c', 'volume_size': 1} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:02 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 1073741824" returned: 0 in 0.940s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:03 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 Nov 05 17:40:03 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:03 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745" returned: 0 in 0.803s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.225s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2029511446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7dbbb2d1004268b15a01d4ff20a06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:02Z,use_quota=True,user_id='20a19e4227bb44c3aa6f7ad5b82ad978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Creating volume 5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:03 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:03 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c 1073741824 Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff56d90a-7638-41cd-aecd-7e9fdbb78968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790956e2-cb54-474e-8e47-7a0bd2c76745', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:03 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be951ff-e782-4456-8a0f-ce3384b2715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Volume volume-790956e2-cb54-474e-8e47-7a0bd2c76745 (790956e2-cb54-474e-8e47-7a0bd2c76745): created successfully Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be951ff-e782-4456-8a0f-ce3384b2715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (37b01105-fd8a-4ba7-8a00-38ccb877faad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b1b04712-459b-47d5-bc5f-752f9f63f2b9 tempest-VolumesGetTest-1285063864 None] Created volume successfully. Nov 05 17:40:04 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c 1073741824" returned: 0 in 0.720s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:04 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c Nov 05 17:40:04 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:05 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c" returned: 0 in 0.563s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce9c276-0ea3-4763-a913-cc2e8b1d034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8782bef8-b8dc-4c5e-849e-4858ef17585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Volume volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c (5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c): created successfully Nov 05 17:40:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8782bef8-b8dc-4c5e-849e-4858ef17585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Flow 'volume_create_manager' (194756fe-1647-4ae0-8f44-834f50e20c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5e54275c-f595-480c-8323-21d928768f87 tempest-ServerRescueNegativeTestJSON-280291255 None] Created volume successfully. Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (c7cf60c6-b27d-484e-b7dc-1d7b61fa6970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242e70ce-72c6-481e-8d86-fcdd4a4e255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242e70ce-72c6-481e-8d86-fcdd4a4e255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1098180802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891a64e4-8113-4256-a135-1dd7e9e1ecd6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=790956e2-cb54-474e-8e47-7a0bd2c76745,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:06Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d077221-bd74-4778-a3ba-d129d923de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d077221-bd74-4778-a3ba-d129d923de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456f5f3b-ba8a-4151-92fe-28e312962b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456f5f3b-ba8a-4151-92fe-28e312962b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '891a64e4-8113-4256-a135-1dd7e9e1ecd6', 'volume_name': 'volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6', 'volume_size': 1, 'source_volid': '790956e2-cb54-474e-8e47-7a0bd2c76745', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ab6316-8268-4160-adcc-0c26d1072b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ab6316-8268-4160-adcc-0c26d1072b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75429b3-1ac1-479f-a094-6cca1a58fae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Volume 891a64e4-8113-4256-a135-1dd7e9e1ecd6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6', 'volume_size': 1, 'source_volid': '790956e2-cb54-474e-8e47-7a0bd2c76745', 'source_volstatus': 'available'} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Cloning volume 790956e2-cb54-474e-8e47-7a0bd2c76745 to volume 891a64e4-8113-4256-a135-1dd7e9e1ecd6 Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Creating offline snapshot fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 of volume 790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc698b-d28e-4d6d-b43a-f654e9d824f3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:07 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 Nov 05 17:40:07 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:07 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745" returned: 0 in 0.645s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:07 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 1G Nov 05 17:40:07 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:08 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 1G" returned: 0 in 0.940s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790956e2-cb54-474e-8e47-7a0bd2c76745 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:08 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790956e2-cb54-474e-8e47-7a0bd2c76745 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 Nov 05 17:40:08 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:08 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790956e2-cb54-474e-8e47-7a0bd2c76745 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" returned: 0 in 0.501s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:08 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 is being set with open permissions: ugo+rw Nov 05 17:40:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:09 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 Nov 05 17:40:09 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:09 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" returned: 0 in 0.657s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:09 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.info Nov 05 17:40:09 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:10 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.info" returned: 0 in 0.544s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:10 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.info is being set with open permissions: ugo+rw Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:10 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.info Nov 05 17:40:10 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:10 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.info" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-891a64e4-8113-4256-a135-1dd7e9e1ecd6" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-891a64e4-8113-4256-a135-1dd7e9e1ecd6" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] snapshot: fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6, volume: 891a64e4-8113-4256-a135-1dd7e9e1ecd6, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2669c6f-e2d0-4cd6-bfa6-04d16879f1bf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:11 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 Nov 05 17:40:11 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:11 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" returned: 0 in 0.703s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-790956e2-cb54-474e-8e47-7a0bd2c76745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:40:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d1b0f-d938-4049-bf17-fab90720be35]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:11 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 Nov 05 17:40:11 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:12 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745" returned: 0 in 0.626s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:40:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:40:12 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:40:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:12 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 Nov 05 17:40:12 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:40:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:13 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:13 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:14 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:40:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:40:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:40:16 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=39,cinder:SELECT=28,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:40:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Acquiring lock "cinder-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "cinder-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Acquiring lock "cinder-quobyte-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "cinder-quobyte-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c" acquired by "delete_volume" :: waited 0.062s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a32e60-4326-447f-a544-5d413147fd52]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:20 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c Nov 05 17:40:20 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:20 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c" returned: 0 in 0.962s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:20 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c Nov 05 17:40:20 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:21 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c" returned: 0 in 0.727s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "cinder-quobyte-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c" released by "delete_volume" :: held 1.823s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Created reservations ['8693204e-3d36-47a6-8ef0-da2d6408f6d5', '1cc4a01f-517d-4485-885d-d7e6ebc7e059', '8d617c07-9df0-47ad-8c8c-36c210c31452', '81c631de-e248-4f28-bc73-83f885bf97cf'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:21 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:21 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:22 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.721s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:22 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Deleted volume successfully. Nov 05 17:40:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-660b61ca-f97f-470a-bac8-145ebdc1e809 tempest-ServerRescueNegativeTestJSON-280291255 None] Lock "cinder-5b2d079f-f5d0-4a8e-aa2e-6a352b1c695c-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:23 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6" returned: 0 in 11.729s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:23 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745, size 1024.00 MB, duration 11.73 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:40:23 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Converted 1024.00 MB image at 87.30 MB/s Nov 05 17:40:23 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 is being set with open permissions: ugo+rw Nov 05 17:40:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:23 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 Nov 05 17:40:23 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:24 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6" returned: 0 in 0.920s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-891a64e4-8113-4256-a135-1dd7e9e1ecd6" released by "_copy_volume_from_snapshot" :: held 14.146s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Deleting offline snapshot fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 of volume 790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:40:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] snapshot_file for this snap is: volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:40:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae5f043-6556-4b2b-9062-e6b9d27a83f9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:25 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 Nov 05 17:40:25 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:25 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" returned: 0 in 0.589s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-790956e2-cb54-474e-8e47-7a0bd2c76745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:40:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1831bae3-e607-48ad-8f8a-de60cf10a25f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:25 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 Nov 05 17:40:25 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:26 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745" returned: 0 in 0.983s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:26 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 Nov 05 17:40:26 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Flow 'volume_create_manager' (adc758c6-6f04-4d73-84a7-b7758829f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f0a24b-29c3-45c5-8f99-4d0cc0d4119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:27 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" returned: 0 in 0.956s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f0a24b-29c3-45c5-8f99-4d0cc0d4119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-184932647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65de756d-07ae-4007-951f-b35b3ad13ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc764afa334347ed9a2cc58f8d8dc821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:27Z,use_quota=True,user_id='b028769229a6405b8b09af9b077701e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647abcb3-e94f-4eaa-bb31-57b9a9e7b194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:27 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6 Nov 05 17:40:27 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647abcb3-e94f-4eaa-bb31-57b9a9e7b194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0632aec3-8833-4fea-84f1-8a7c1197a79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0632aec3-8833-4fea-84f1-8a7c1197a79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65de756d-07ae-4007-951f-b35b3ad13ed0', 'volume_name': 'volume-65de756d-07ae-4007-951f-b35b3ad13ed0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c751f56-3954-43fd-939a-d60c34bddf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c751f56-3954-43fd-939a-d60c34bddf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c34281-955b-4d2f-9e71-2978f700dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Volume 65de756d-07ae-4007-951f-b35b3ad13ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65de756d-07ae-4007-951f-b35b3ad13ed0', 'volume_size': 1} Nov 05 17:40:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:28 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745.fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" returned: 0 in 0.337s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-fe3cb0c1-2f24-4fcb-94d8-437dbc2e82a6" released by "_delete_snapshot" :: held 3.129s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Flow 'volume_create_manager' (b44d5d8a-8665-4206-b454-25d242de44d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3deae951-0947-4d1d-a8da-ca0477cb6a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3deae951-0947-4d1d-a8da-ca0477cb6a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911245480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ed8036-742d-4bdf-b3da-d294ce29743a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b87c0c7fc64dd79e40dd33fe72c8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:28Z,use_quota=True,user_id='d9c03fb02dcc42b9bca12f52a3b64413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1899b80c-b324-40a7-aeaf-7995e973c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1899b80c-b324-40a7-aeaf-7995e973c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2774837b-f689-4fcf-8526-593ea4f17f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2774837b-f689-4fcf-8526-593ea4f17f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ed8036-742d-4bdf-b3da-d294ce29743a', 'volume_name': 'volume-11ed8036-742d-4bdf-b3da-d294ce29743a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c79a805-feb5-41ab-b17d-1dabe16d4918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c79a805-feb5-41ab-b17d-1dabe16d4918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a559c96-14df-4241-b16a-9a51b26f4393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Volume 11ed8036-742d-4bdf-b3da-d294ce29743a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ed8036-742d-4bdf-b3da-d294ce29743a', 'volume_size': 1} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.423s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-184932647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65de756d-07ae-4007-951f-b35b3ad13ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc764afa334347ed9a2cc58f8d8dc821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:27Z,use_quota=True,user_id='b028769229a6405b8b09af9b077701e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Creating volume 65de756d-07ae-4007-951f-b35b3ad13ed0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:28 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:28 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 1073741824 Nov 05 17:40:28 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75429b3-1ac1-479f-a094-6cca1a58fae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6', 'volume_size': 1, 'source_volid': '790956e2-cb54-474e-8e47-7a0bd2c76745', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8cc695-ac58-4d85-a853-9f5eae473007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Volume volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 (891a64e4-8113-4256-a135-1dd7e9e1ecd6): created successfully Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8cc695-ac58-4d85-a853-9f5eae473007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (c7cf60c6-b27d-484e-b7dc-1d7b61fa6970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5211616b-ffd5-4475-8256-ceefa4ecae32 tempest-VolumesGetTest-1285063864 None] Created volume successfully. Nov 05 17:40:28 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 1073741824" returned: 0 in 0.636s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:28 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 Nov 05 17:40:28 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:29 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911245480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ed8036-742d-4bdf-b3da-d294ce29743a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b87c0c7fc64dd79e40dd33fe72c8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:28Z,use_quota=True,user_id='d9c03fb02dcc42b9bca12f52a3b64413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Creating volume 11ed8036-742d-4bdf-b3da-d294ce29743a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:29 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c34281-955b-4d2f-9e71-2978f700dc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65de756d-07ae-4007-951f-b35b3ad13ed0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:29 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a 1073741824 Nov 05 17:40:29 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c02637-d23c-4638-9a4b-64ae35c9489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Volume volume-65de756d-07ae-4007-951f-b35b3ad13ed0 (65de756d-07ae-4007-951f-b35b3ad13ed0): created successfully Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c02637-d23c-4638-9a4b-64ae35c9489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Flow 'volume_create_manager' (adc758c6-6f04-4d73-84a7-b7758829f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d012dcbf-a93c-42d8-9259-cdd9ed6e1efa tempest-AbsoluteLimitsTests-1076050814 None] Created volume successfully. Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (897d43bb-6d2b-453f-93e4-afe91d0aaefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39203c4-a74e-4b69-961a-4d69e05f6853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39203c4-a74e-4b69-961a-4d69e05f6853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-395183266',display_name='tempest-VolumesGetTest-Volume-35377128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04a13ee-6de0-4add-b5f6-6500af91e48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:30Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f309a-5453-4f68-9784-eb6da59022eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f309a-5453-4f68-9784-eb6da59022eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807e59a2-bb12-4ed0-af73-ea7f8974aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807e59a2-bb12-4ed0-af73-ea7f8974aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04a13ee-6de0-4add-b5f6-6500af91e48b', 'volume_name': 'volume-d04a13ee-6de0-4add-b5f6-6500af91e48b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f703175-caea-4917-8a21-61fa93352582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f703175-caea-4917-8a21-61fa93352582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3343c1-1dd9-46df-bb23-8e0b4df6b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Volume d04a13ee-6de0-4add-b5f6-6500af91e48b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04a13ee-6de0-4add-b5f6-6500af91e48b', 'volume_size': 1} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Acquiring lock "cinder-65de756d-07ae-4007-951f-b35b3ad13ed0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:29 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a 1073741824" returned: 0 in 0.709s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Lock "cinder-65de756d-07ae-4007-951f-b35b3ad13ed0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:30 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a Nov 05 17:40:30 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Acquiring lock "cinder-quobyte-65de756d-07ae-4007-951f-b35b3ad13ed0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Lock "cinder-quobyte-65de756d-07ae-4007-951f-b35b3ad13ed0" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[904a1c3b-6763-4454-aedb-900c40465ba6]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:30 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 Nov 05 17:40:30 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:30 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a" returned: 0 in 0.429s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-395183266',display_name='tempest-VolumesGetTest-Volume-35377128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04a13ee-6de0-4add-b5f6-6500af91e48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:30Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Creating volume d04a13ee-6de0-4add-b5f6-6500af91e48b {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:30 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a559c96-14df-4241-b16a-9a51b26f4393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ed8036-742d-4bdf-b3da-d294ce29743a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:30 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b 1073741824 Nov 05 17:40:30 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7ea0c5-24af-4ce1-b6d9-af9410ce0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Volume volume-11ed8036-742d-4bdf-b3da-d294ce29743a (11ed8036-742d-4bdf-b3da-d294ce29743a): created successfully Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7ea0c5-24af-4ce1-b6d9-af9410ce0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Flow 'volume_create_manager' (b44d5d8a-8665-4206-b454-25d242de44d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9b4af9e4-fc89-487f-8a9a-550b828f5812 tempest-AttachVolumeNegativeTest-2082876409 None] Created volume successfully. Nov 05 17:40:31 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0" returned: 0 in 0.870s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:31 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0 Nov 05 17:40:31 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:31 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b 1073741824" returned: 0 in 0.684s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:31 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b Nov 05 17:40:31 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:31 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-65de756d-07ae-4007-951f-b35b3ad13ed0" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Lock "cinder-quobyte-65de756d-07ae-4007-951f-b35b3ad13ed0" released by "delete_volume" :: held 1.353s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Created reservations ['cb227e99-21c3-4f59-ab68-51476d4439cd', '916b0883-696c-481b-98d3-ef8d908536e4', 'dccdf1f6-9535-44ca-9c43-c2ca63835812', 'a4a84283-9399-43af-a72f-6c831c7632e5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:31 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3343c1-1dd9-46df-bb23-8e0b4df6b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04a13ee-6de0-4add-b5f6-6500af91e48b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716990e6-f336-42d8-8b95-c727e2d408fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Volume volume-d04a13ee-6de0-4add-b5f6-6500af91e48b (d04a13ee-6de0-4add-b5f6-6500af91e48b): created successfully Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716990e6-f336-42d8-8b95-c727e2d408fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (897d43bb-6d2b-453f-93e4-afe91d0aaefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f56a957d-f1b3-4851-aede-32fa5bf799b9 tempest-VolumesGetTest-1285063864 None] Created volume successfully. Nov 05 17:40:31 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:31 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:31 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:31 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Deleted volume successfully. Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1fe5bea6-7b6c-4c34-82f6-6f27058a2b4b tempest-AbsoluteLimitsTests-1076050814 None] Lock "cinder-65de756d-07ae-4007-951f-b35b3ad13ed0-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-d04a13ee-6de0-4add-b5f6-6500af91e48b-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Lock "cinder-d04a13ee-6de0-4add-b5f6-6500af91e48b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-d143c64c-386c-4aa7-9a06-c0a0a2d4ff8c req-e97e0184-df39-44f5-84e1-fcab6007e6ee tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-d143c64c-386c-4aa7-9a06-c0a0a2d4ff8c req-e97e0184-df39-44f5-84e1-fcab6007e6ee tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-d143c64c-386c-4aa7-9a06-c0a0a2d4ff8c req-e97e0184-df39-44f5-84e1-fcab6007e6ee tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-d04a13ee-6de0-4add-b5f6-6500af91e48b" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-d04a13ee-6de0-4add-b5f6-6500af91e48b" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-d143c64c-386c-4aa7-9a06-c0a0a2d4ff8c req-e97e0184-df39-44f5-84e1-fcab6007e6ee tempest-AttachVolumeNegativeTest-2082876409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-11ed8036-742d-4bdf-b3da-d294ce29743a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f649554-a61d-4356-923b-74cbe42fda89', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb3187-70ef-42c9-8f47-ff09f2b5df2e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-d143c64c-386c-4aa7-9a06-c0a0a2d4ff8c req-e97e0184-df39-44f5-84e1-fcab6007e6ee tempest-AttachVolumeNegativeTest-2082876409 None] attachment_update completed successfully. Nov 05 17:40:32 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b Nov 05 17:40:32 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:32 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b" returned: 0 in 0.470s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:32 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b Nov 05 17:40:32 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:33 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d04a13ee-6de0-4add-b5f6-6500af91e48b" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-d04a13ee-6de0-4add-b5f6-6500af91e48b" released by "delete_volume" :: held 0.909s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Created reservations ['59c2d9b9-35dc-4212-ae99-fd381a0e879b', 'cc1edeac-ddee-47ac-a5bb-98a99e9a0410', '8ac94cff-7971-4abc-9693-6aed96e20ab0', '8ad4cafb-05d1-40cc-b380-a624d156575d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:33 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:33 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:33 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.294s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Deleted volume successfully. Nov 05 17:40:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec974b07-b801-417b-8505-542fb5679933 tempest-VolumesGetTest-1285063864 None] Lock "cinder-d04a13ee-6de0-4add-b5f6-6500af91e48b-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-891a64e4-8113-4256-a135-1dd7e9e1ecd6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Lock "cinder-891a64e4-8113-4256-a135-1dd7e9e1ecd6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-891a64e4-8113-4256-a135-1dd7e9e1ecd6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-891a64e4-8113-4256-a135-1dd7e9e1ecd6" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3c5c0a-60a1-477e-864a-a5386a863932]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:34 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 Nov 05 17:40:34 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:35 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6" returned: 0 in 0.454s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:35 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6 Nov 05 17:40:35 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:35 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-891a64e4-8113-4256-a135-1dd7e9e1ecd6" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-891a64e4-8113-4256-a135-1dd7e9e1ecd6" released by "delete_volume" :: held 0.843s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Created reservations ['cca666c2-664a-485f-ad71-2968a413ba70', 'fba3c85c-6180-4149-8e8d-ede3c86c4832', '6e188b57-393c-433a-911d-ec876db56b4a', '85a6b0b2-c67e-4b9d-abd6-933d69cdf748'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:35 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:35 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-790956e2-cb54-474e-8e47-7a0bd2c76745-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Lock "cinder-790956e2-cb54-474e-8e47-7a0bd2c76745-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:35 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-790956e2-cb54-474e-8e47-7a0bd2c76745" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Deleted volume successfully. Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-790956e2-cb54-474e-8e47-7a0bd2c76745" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd0e2599-e61d-4f3e-972e-857c6ff2c99f tempest-VolumesGetTest-1285063864 None] Lock "cinder-891a64e4-8113-4256-a135-1dd7e9e1ecd6-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f439b70-e828-4080-bfbb-fdfe1c857231]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:36 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 Nov 05 17:40:36 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:36 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745" returned: 0 in 0.454s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:36 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745 Nov 05 17:40:36 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:36 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-790956e2-cb54-474e-8e47-7a0bd2c76745" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-790956e2-cb54-474e-8e47-7a0bd2c76745" released by "delete_volume" :: held 0.903s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Created reservations ['109d9c57-64e4-4fc8-9b82-59e5c0fb844b', '7f4ba1e0-6051-403c-ae5b-ffb70642b881', '38f06d7b-6d0b-4f05-a94a-d63596b9b690', 'e7509caf-cd85-49e3-bdf9-96dadcfa294c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:37 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:37 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:37 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.487s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:37 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Deleted volume successfully. Nov 05 17:40:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-80123248-3386-4237-8e40-15bf6f277bd4 tempest-VolumesGetTest-1285063864 None] Lock "cinder-790956e2-cb54-474e-8e47-7a0bd2c76745-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (1f34aa29-a8c7-4a6a-b325-f347b0406291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643230c7-5f7b-4f85-8d76-ad01b7a331b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643230c7-5f7b-4f85-8d76-ad01b7a331b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1564146868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af10385-4545-412e-bc17-f87795e67d8a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:38Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300001c9-3740-4688-a2be-e31734c24f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300001c9-3740-4688-a2be-e31734c24f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd6f85f-ab94-4c12-8838-2bfa03884abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:38 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd6f85f-ab94-4c12-8838-2bfa03884abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6af10385-4545-412e-bc17-f87795e67d8a', 'volume_name': 'volume-6af10385-4545-412e-bc17-f87795e67d8a', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbb1298-ace8-4056-a9d3-0513dfbd42bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbb1298-ace8-4056-a9d3-0513dfbd42bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1e1258-8392-464c-93ee-e7afaf63dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Volume 6af10385-4545-412e-bc17-f87795e67d8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6af10385-4545-412e-bc17-f87795e67d8a', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Trying to clone 6af10385-4545-412e-bc17-f87795e67d8a from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:40:39 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Image download 20.69 MB at 20.69 MB/s Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed54dfd5-e835-49c3-8954-5ba009e594fc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:40 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD Nov 05 17:40:40 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Flow 'volume_create_manager' (ecb770a4-54d9-4f8c-8575-c34b16f30c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcb6d27-20de-451f-ad7e-a77afd2bfbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcb6d27-20de-451f-ad7e-a77afd2bfbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1309173418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd80da2b8da434ea56a36c2fa30d32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:40Z,use_quota=True,user_id='6f91e9d726f64192b6acd61dbd024721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9127b7a7-bad1-4fd0-8cc8-701e4c4d4dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9127b7a7-bad1-4fd0-8cc8-701e4c4d4dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad57c7f-dc09-4e09-8e1e-dba63a0ac5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad57c7f-dc09-4e09-8e1e-dba63a0ac5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5', 'volume_name': 'volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e377ef1-2bea-4b2a-ba28-2f02acfc2ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e377ef1-2bea-4b2a-ba28-2f02acfc2ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d36c5f8-434e-4879-ba16-14e803de2aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Volume 4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5', 'volume_size': 1} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1309173418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd80da2b8da434ea56a36c2fa30d32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:40Z,use_quota=True,user_id='6f91e9d726f64192b6acd61dbd024721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Creating volume 4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:40 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 1073741824 Nov 05 17:40:40 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:40 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a is fetched for user 850a390506a34b01b53b8c748a003bfb. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b72de-af72-400f-b9c3-3d368bb8a56e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:40 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD Nov 05 17:40:40 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:40 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 1073741824" returned: 0 in 0.581s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:40 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:40 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 Nov 05 17:40:40 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:41 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1564146868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af10385-4545-412e-bc17-f87795e67d8a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:38Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Creating volume 6af10385-4545-412e-bc17-f87795e67d8a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d36c5f8-434e-4879-ba16-14e803de2aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e427055-7acd-4a25-80c8-774145316a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:41 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a 1073741824 Nov 05 17:40:41 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Volume volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 (4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5): created successfully Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e427055-7acd-4a25-80c8-774145316a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Flow 'volume_create_manager' (ecb770a4-54d9-4f8c-8575-c34b16f30c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2e26d3b9-6c01-40ec-a09f-a4c5150c0e14 tempest-VolumesDeleteCascade-1005037547 None] Created volume successfully. Nov 05 17:40:41 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a 1073741824" returned: 0 in 0.623s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:42 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a Nov 05 17:40:42 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:42 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Attempting download of 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 6af10385-4545-412e-bc17-f87795e67d8a. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d019cf9-c9d6-4195-b212-7b65a0edc6d5]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_uji_poso {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Creating offline snapshot 4fca57fa-0dd3-4721-bb70-6afd4c9b4813 of volume 4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec44b40-7b08-4ab3-807a-8f8630dfa878]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:42 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_uji_poso Nov 05 17:40:42 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:42 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 Nov 05 17:40:42 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:43 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_uji_poso" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_uji_poso {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:43 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_uji_poso Nov 05 17:40:43 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:43 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" returned: 0 in 0.522s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:43 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 1G Nov 05 17:40:43 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:43 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_uji_poso" returned: 1 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_uji_poso' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553d268-bb99-45b3-b9d5-512139897b92]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:43 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD Nov 05 17:40:43 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:43 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 1G" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:43 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 Nov 05 17:40:43 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:43 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] 801ade9d-3bc5-40a6-b715-627da3a7cb0a was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:40:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:43 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a Nov 05 17:40:43 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:44 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:44 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 is being set with open permissions: ugo+rw Nov 05 17:40:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:44 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 Nov 05 17:40:44 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:44 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813" returned: 0 in 0.316s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:44 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.info Nov 05 17:40:44 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:44 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.info" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:44 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.info is being set with open permissions: ugo+rw Nov 05 17:40:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:44 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.info Nov 05 17:40:44 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:45 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.info" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-289f6ec9-06cc-4658-8782-3063c84126a1 tempest-VolumesDeleteCascade-1005037547 None] Create snapshot completed successfully Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Creating offline snapshot cbe08b27-8916-48a7-af43-7f08cd77b955 of volume 4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1610244-49a5-4c50-92bd-9cd4976be25c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:46 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a" returned: 0 in 2.823s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_q5rd505gdevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:40:46 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Converted 112.00 MB image at 39.66 MB/s Nov 05 17:40:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:46 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 Nov 05 17:40:46 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:46 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a 1G Nov 05 17:40:46 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:47 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813" returned: 0 in 0.497s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:47 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 1G Nov 05 17:40:47 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:47 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a 1G" returned: 0 in 0.582s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Downloaded image 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 6af10385-4545-412e-bc17-f87795e67d8a successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a for user 850a390506a34b01b53b8c748a003bfb is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Marking volume 6af10385-4545-412e-bc17-f87795e67d8a as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Copying metadata from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a to 6af10385-4545-412e-bc17-f87795e67d8a. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Creating volume glance metadata for volume 6af10385-4545-412e-bc17-f87795e67d8a backed by image 801ade9d-3bc5-40a6-b715-627da3a7cb0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1e1258-8392-464c-93ee-e7afaf63dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af10385-4545-412e-bc17-f87795e67d8a', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb45dc-6d30-4d1d-821f-16ee70159685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Volume volume-6af10385-4545-412e-bc17-f87795e67d8a (6af10385-4545-412e-bc17-f87795e67d8a): created successfully Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb45dc-6d30-4d1d-821f-16ee70159685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (1f34aa29-a8c7-4a6a-b325-f347b0406291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9b72bd74-0433-45d8-81b8-11e96088e79f tempest-VolumesGetTest-1285063864 None] Created volume successfully. Nov 05 17:40:47 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 1G" returned: 0 in 0.761s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:47 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 Nov 05 17:40:47 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:48 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955" returned: 0 in 0.722s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:48 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 is being set with open permissions: ugo+rw Nov 05 17:40:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:48 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 Nov 05 17:40:48 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:48 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955" returned: 0 in 0.495s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-54cd8597-3bae-468e-8d14-6612e772e00c tempest-VolumesDeleteCascade-1005037547 None] Create snapshot completed successfully Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (f62bb45f-5f28-46ed-b0d4-188f5c2cd09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480a2dad-a0fd-4bd7-8cc0-c0913759b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Performing cascade delete. {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480a2dad-a0fd-4bd7-8cc0-c0913759b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1787523335',display_name='tempest-VolumesGetTest-Volume-611361760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad02a98e-4012-4d35-80cb-6fda9e6290bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:50Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39400c7-0ce7-490a-a49c-db0de8df9d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39400c7-0ce7-490a-a49c-db0de8df9d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f5d35c-a00a-4812-a549-b78c71c5e724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f5d35c-a00a-4812-a549-b78c71c5e724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad02a98e-4012-4d35-80cb-6fda9e6290bb', 'volume_name': 'volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a32b784-27f9-4520-8383-c79e48ad7425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a32b784-27f9-4520-8383-c79e48ad7425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e676c726-7f61-4ed8-9c1a-01a6d90f21ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:49 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Volume ad02a98e-4012-4d35-80cb-6fda9e6290bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb', 'volume_size': 1} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:40:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1787523335',display_name='tempest-VolumesGetTest-Volume-611361760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad02a98e-4012-4d35-80cb-6fda9e6290bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa655f66887499295471e305c216a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:40:50Z,use_quota=True,user_id='850a390506a34b01b53b8c748a003bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Creating volume ad02a98e-4012-4d35-80cb-6fda9e6290bb {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:40:49 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-4fca57fa-0dd3-4721-bb70-6afd4c9b4813-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-4fca57fa-0dd3-4721-bb70-6afd4c9b4813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:49 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb 1073741824 Nov 05 17:40:49 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-4fca57fa-0dd3-4721-bb70-6afd4c9b4813" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4fca57fa-0dd3-4721-bb70-6afd4c9b4813" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Deleting offline snapshot 4fca57fa-0dd3-4721-bb70-6afd4c9b4813 of volume 4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] snapshot_file for this snap is: volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69de1c1-8f95-4e71-89c2-0ffe275d1cf4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:50 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 Nov 05 17:40:50 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:50 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb 1073741824" returned: 0 in 0.824s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:50 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813" returned: 0 in 0.732s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:40:50 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb Nov 05 17:40:50 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ef625-68f1-4339-9d95-0898303fa6c2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:51 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:51 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 Nov 05 17:40:51 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e676c726-7f61-4ed8-9c1a-01a6d90f21ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fbc26f-c679-41b8-965f-17188304ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:40:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Volume volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb (ad02a98e-4012-4d35-80cb-6fda9e6290bb): created successfully Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fbc26f-c679-41b8-965f-17188304ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Flow 'volume_create_manager' (f62bb45f-5f28-46ed-b0d4-188f5c2cd09f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:40:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a8f3689b-92d4-4c26-9f93-997ee6a2df49 tempest-VolumesGetTest-1285063864 None] Created volume successfully. Nov 05 17:40:51 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" returned: 0 in 0.758s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9005210-d33a-4ece-bdff-4d9572c08991]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:51 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 Nov 05 17:40:51 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-ad02a98e-4012-4d35-80cb-6fda9e6290bb-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Lock "cinder-ad02a98e-4012-4d35-80cb-6fda9e6290bb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-ad02a98e-4012-4d35-80cb-6fda9e6290bb" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-ad02a98e-4012-4d35-80cb-6fda9e6290bb" acquired by "delete_volume" :: waited 0.049s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3bd3ae-f0ba-46f8-9249-593acade228b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:52 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955" returned: 0 in 0.802s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec01cbb-40ca-4a60-b6ab-d8ea5c4f0633]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:52 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb Nov 05 17:40:52 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:52 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 Nov 05 17:40:52 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:52 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb" returned: 0 in 0.463s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:53 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb Nov 05 17:40:53 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:53 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bfdec4-c994-4a91-a0ae-b23921fc882a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:53 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 Nov 05 17:40:53 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:53 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ad02a98e-4012-4d35-80cb-6fda9e6290bb" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-ad02a98e-4012-4d35-80cb-6fda9e6290bb" released by "delete_volume" :: held 0.910s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Created reservations ['444263da-e5b7-4b9d-8210-ee868cb97306', 'e606f930-c8dc-42b2-af95-bd7f451e454b', '139d64b6-14a9-43cd-8d58-cec0d2da5618', 'b21c2272-5428-46cf-8b98-1300b00f8bf9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:53 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:53 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-6af10385-4545-412e-bc17-f87795e67d8a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:53 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Lock "cinder-6af10385-4545-412e-bc17-f87795e67d8a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" returned: 0 in 0.708s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:53 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 Nov 05 17:40:53 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Acquiring lock "cinder-quobyte-6af10385-4545-412e-bc17-f87795e67d8a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-6af10385-4545-412e-bc17-f87795e67d8a" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b0542-ae80-4793-b6d6-c67c481389b2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:54 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a Nov 05 17:40:54 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:54 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.622s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Deleted volume successfully. Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bfa0a9ee-8205-43fe-8fdd-08e1cf07b249 tempest-VolumesGetTest-1285063864 None] Lock "cinder-ad02a98e-4012-4d35-80cb-6fda9e6290bb-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:54 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813" returned: 0 in 0.567s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:54 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813 Nov 05 17:40:54 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:54 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a" returned: 0 in 0.634s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:54 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a Nov 05 17:40:54 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:54 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.4fca57fa-0dd3-4721-bb70-6afd4c9b4813" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 -F qcow2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:54 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 -F qcow2 Nov 05 17:40:54 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:55 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6af10385-4545-412e-bc17-f87795e67d8a" returned: 0 in 0.456s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Lock "cinder-quobyte-6af10385-4545-412e-bc17-f87795e67d8a" released by "delete_volume" :: held 1.161s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Created reservations ['a37112f6-c853-47d8-92b5-3bcb9bb99817', '2bd0f1bf-bdec-4790-b894-3b9bb3fc7385', '82ece0cd-ec54-47e1-a6e8-bfea58bedd13', '4ee3fcca-b61d-47c2-b14f-7090c76828ce'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:55 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:55 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:55 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 -F qcow2" returned: 0 in 0.651s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4fca57fa-0dd3-4721-bb70-6afd4c9b4813" released by "_delete_snapshot" :: held 5.452s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" released by "delete_snapshot" :: held 5.488s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Created reservations ['c13d53fd-e1d8-4907-9133-e3fafffdc6ef', 'e137dfac-3fde-4f5a-a4f0-564ab4c28665', '3d83f3c1-bb0a-4188-a5a7-65b787152a02', 'a5ccc230-00aa-4ff6-a645-985b9dd817b6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Delete snapshot completed successfully. Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-4fca57fa-0dd3-4721-bb70-6afd4c9b4813-delete_snapshot" released by "delete_snapshot" :: held 5.796s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-cbe08b27-8916-48a7-af43-7f08cd77b955-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-cbe08b27-8916-48a7-af43-7f08cd77b955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:55 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.553s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:40:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Deleted volume successfully. Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-cbe08b27-8916-48a7-af43-7f08cd77b955" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5909f5c3-59a2-4077-8c80-20514a3be60b tempest-VolumesGetTest-1285063864 None] Lock "cinder-6af10385-4545-412e-bc17-f87795e67d8a-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-cbe08b27-8916-48a7-af43-7f08cd77b955" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Deleting offline snapshot cbe08b27-8916-48a7-af43-7f08cd77b955 of volume 4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] snapshot_file for this snap is: volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67be0f4-ea46-4e05-a35f-26520bcd2b14]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:56 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 Nov 05 17:40:56 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:56 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955" returned: 0 in 0.779s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b3089e-9d79-478f-b116-89b92ccefe18]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:57 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 Nov 05 17:40:57 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:57 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" returned: 0 in 0.533s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:57 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 Nov 05 17:40:57 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:57 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955" returned: 0 in 0.454s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:57 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955 Nov 05 17:40:57 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:58 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5.cbe08b27-8916-48a7-af43-7f08cd77b955" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-cbe08b27-8916-48a7-af43-7f08cd77b955" released by "_delete_snapshot" :: held 2.345s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" released by "delete_snapshot" :: held 2.419s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Created reservations ['ac257596-c857-4cc0-9c33-9b6529dccbc9', 'beb32bfd-3049-4008-8329-5d115a072e0b', 'f352872e-7c99-41ba-9198-141fa034ccdc', 'c07f5119-1adf-42b8-a6eb-3b1113fb61d7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Delete snapshot completed successfully. Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-cbe08b27-8916-48a7-af43-7f08cd77b955-delete_snapshot" released by "delete_snapshot" :: held 2.814s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Snapshots deleted, issuing volume delete {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b9d1c-d1ed-41ae-b696-1a9f529f7529]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:40:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:58 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 Nov 05 17:40:58 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:59 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" returned: 0 in 0.580s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:59 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5 Nov 05 17:40:59 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:40:59 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5" released by "delete_volume" :: held 1.032s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Created reservations ['4ff39b55-86fe-45fd-bbee-7e36a1e3d09b', 'd8883fd5-5582-45fe-9951-37c1cb98d028', '99da1aac-b148-4c7f-975d-6bc189e1bf3e', 'd198f89b-bbc9-414f-ae82-e08101178b77'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:40:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:40:59 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:40:59 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:00 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.448s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:00 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:41:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Deleted volume successfully. Nov 05 17:41:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a565c9b-cfeb-4403-a01f-276ad1fdd0a5 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-4e6f6c56-42b8-44e7-8fc9-4ee0a0931be5-delete_volume" released by "delete_volume" :: held 10.704s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Flow 'volume_create_manager' (d9297484-4450-40e8-a0ff-0b05235a9c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdf45c-15b3-4797-b127-d7bc46aa747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdf45c-15b3-4797-b127-d7bc46aa747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2104430573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5daa7e-7ee8-4520-b45e-a0e23fa73333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd80da2b8da434ea56a36c2fa30d32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:02Z,use_quota=True,user_id='6f91e9d726f64192b6acd61dbd024721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340fadc9-cc0e-4130-acce-3368f51644b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340fadc9-cc0e-4130-acce-3368f51644b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19aacd6-8311-44a5-8e8d-f2499a11f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19aacd6-8311-44a5-8e8d-f2499a11f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5daa7e-7ee8-4520-b45e-a0e23fa73333', 'volume_name': 'volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff9eac5-8e94-4365-8e40-f7e9380e50b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff9eac5-8e94-4365-8e40-f7e9380e50b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2997691b-ee00-4269-bcaf-08c7cf1eecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Volume 1d5daa7e-7ee8-4520-b45e-a0e23fa73333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333', 'volume_size': 1} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2104430573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5daa7e-7ee8-4520-b45e-a0e23fa73333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd80da2b8da434ea56a36c2fa30d32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:02Z,use_quota=True,user_id='6f91e9d726f64192b6acd61dbd024721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Creating volume 1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:41:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:02 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 1073741824 Nov 05 17:41:02 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Flow 'volume_create_manager' (3a311f41-c4ad-468d-a143-2cd8fb1c6fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b84cbb2-a65c-4d3c-abf6-1a45869bdaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b84cbb2-a65c-4d3c-abf6-1a45869bdaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1156659990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0991de6-7902-4659-a308-56045458d18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d071968fdad4af882251fa0242525d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:02Z,use_quota=True,user_id='80fcfd00a0d44365ad177c482949afdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27363072-89b8-4d06-bc13-f96c80551d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27363072-89b8-4d06-bc13-f96c80551d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792178c9-4c08-4d51-9207-3cb1caddab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792178c9-4c08-4d51-9207-3cb1caddab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0991de6-7902-4659-a308-56045458d18b', 'volume_name': 'volume-f0991de6-7902-4659-a308-56045458d18b', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f531ec2-8053-476a-92b3-08be875a43e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f531ec2-8053-476a-92b3-08be875a43e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2b4ccd-8adc-4e47-a723-8a770672cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Volume f0991de6-7902-4659-a308-56045458d18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0991de6-7902-4659-a308-56045458d18b', 'volume_size': 2} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:02 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 1073741824" returned: 0 in 0.451s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=90,cinder:UPDATE=115,cinder:DELETE=12,cinder:INSERT=29 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:02 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 Nov 05 17:41:02 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:02 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" returned: 0 in 0.286s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1156659990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0991de6-7902-4659-a308-56045458d18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d071968fdad4af882251fa0242525d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:02Z,use_quota=True,user_id='80fcfd00a0d44365ad177c482949afdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Creating volume f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:41:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b 2147483648 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2997691b-ee00-4269-bcaf-08c7cf1eecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b 2147483648 Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9209c177-8006-4cc6-9a03-cd8645df2ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:02 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Volume volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 (1d5daa7e-7ee8-4520-b45e-a0e23fa73333): created successfully Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9209c177-8006-4cc6-9a03-cd8645df2ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Flow 'volume_create_manager' (d9297484-4450-40e8-a0ff-0b05235a9c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f8a2b60f-66fe-4cb4-b043-e41f7cc06f1e tempest-VolumesDeleteCascade-1005037547 None] Created volume successfully. Nov 05 17:41:03 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b 2147483648" returned: 0 in 0.544s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:03 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b Nov 05 17:41:03 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:03 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2b4ccd-8adc-4e47-a723-8a770672cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0991de6-7902-4659-a308-56045458d18b', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a05cf87-f239-4ea5-ac8e-d2ad82a40deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Volume volume-f0991de6-7902-4659-a308-56045458d18b (f0991de6-7902-4659-a308-56045458d18b): created successfully Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a05cf87-f239-4ea5-ac8e-d2ad82a40deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Flow 'volume_create_manager' (3a311f41-c4ad-468d-a143-2cd8fb1c6fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-06853293-6856-42ae-8596-484033343dc6 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Created volume successfully. Nov 05 17:41:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Creating offline snapshot aa55364e-aecc-40fd-90e2-69e1b68a9c8f of volume 1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:41:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[77779174-c9be-4ca7-949e-b25a0549e6a7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:04 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 Nov 05 17:41:04 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:05 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" returned: 0 in 0.572s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:05 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f 1G Nov 05 17:41:05 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:05 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f 1G" returned: 0 in 0.510s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:05 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f Nov 05 17:41:05 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:06 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:06 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f is being set with open permissions: ugo+rw Nov 05 17:41:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:06 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f Nov 05 17:41:06 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:06 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f" returned: 0 in 0.426s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:06 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.info Nov 05 17:41:06 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:07 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.info" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:07 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.info is being set with open permissions: ugo+rw Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:07 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.info Nov 05 17:41:07 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:07 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.info" returned: 0 in 0.300s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.698s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Creating offline snapshot 2a818253-0d2a-418c-9f04-e8df52944372 of volume f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:41:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f1599cba-c097-49cb-a93f-543665716708 tempest-VolumesDeleteCascade-1005037547 None] Create snapshot completed successfully Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3eaeb6-1aac-4762-a678-043714519448]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:07 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b Nov 05 17:41:07 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:07 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b" returned: 0 in 0.546s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 2G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:08 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 2G Nov 05 17:41:08 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Flow 'volume_create_manager' (2f523b69-76b0-4f2d-8e2b-dd742317f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82593f50-b219-477c-9d32-94c6bb88d75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82593f50-b219-477c-9d32-94c6bb88d75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1789536384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714b2371-1cb9-4430-b4d7-7c5d77e4da2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd80da2b8da434ea56a36c2fa30d32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa55364e-aecc-40fd-90e2-69e1b68a9c8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:09Z,use_quota=True,user_id='6f91e9d726f64192b6acd61dbd024721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:08 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62967d6-d099-40db-98ff-25cfbda2d170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62967d6-d099-40db-98ff-25cfbda2d170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c7dbb3-f72e-4722-8529-240d8e148d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c7dbb3-f72e-4722-8529-240d8e148d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '714b2371-1cb9-4430-b4d7-7c5d77e4da2a', 'volume_name': 'volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a', 'volume_size': 1, 'snapshot_id': 'aa55364e-aecc-40fd-90e2-69e1b68a9c8f'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b0b56b-ffe2-42f0-994b-6576fca284bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b0b56b-ffe2-42f0-994b-6576fca284bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10da4c7-e81c-4f53-bf43-594b509d08b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Volume 714b2371-1cb9-4430-b4d7-7c5d77e4da2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a', 'volume_size': 1, 'snapshot_id': 'aa55364e-aecc-40fd-90e2-69e1b68a9c8f'} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 2G" returned: 0 in 0.830s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0991de6-7902-4659-a308-56045458d18b -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:08 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0991de6-7902-4659-a308-56045458d18b -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 Nov 05 17:41:08 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:09 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0991de6-7902-4659-a308-56045458d18b -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:09 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 is being set with open permissions: ugo+rw Nov 05 17:41:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:09 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 Nov 05 17:41:09 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:09 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372" returned: 0 in 0.286s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:09 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.info Nov 05 17:41:09 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:09 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.info" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:09 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.info is being set with open permissions: ugo+rw Nov 05 17:41:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:09 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.info Nov 05 17:41:09 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:10 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.info" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.508s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-aa55364e-aecc-40fd-90e2-69e1b68a9c8f-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-aa55364e-aecc-40fd-90e2-69e1b68a9c8f-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Creating volume 714b2371-1cb9-4430-b4d7-7c5d77e4da2a from snapshot aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2057f3d5-aac9-40a5-acb1-0353aaeabc46 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Create snapshot completed successfully Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] snapshot: aa55364e-aecc-40fd-90e2-69e1b68a9c8f, volume: 714b2371-1cb9-4430-b4d7-7c5d77e4da2a, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f382ad7-436c-4d20-bf4f-dce1057f91c0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:10 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f Nov 05 17:41:10 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "cinder-2a818253-0d2a-418c-9f04-e8df52944372-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-2a818253-0d2a-418c-9f04-e8df52944372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "cinder-quobyte-f0991de6-7902-4659-a308-56045458d18b" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-quobyte-f0991de6-7902-4659-a308-56045458d18b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "cinder-quobyte-2a818253-0d2a-418c-9f04-e8df52944372" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-quobyte-2a818253-0d2a-418c-9f04-e8df52944372" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Deleting offline snapshot 2a818253-0d2a-418c-9f04-e8df52944372 of volume f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] snapshot_file for this snap is: volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f322d63-0c1b-4126-b6c6-43a34c07445b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:11 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f" returned: 0 in 0.660s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2865e6-3e98-4217-b97a-cf06aeb2fe11]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:11 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 Nov 05 17:41:11 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:11 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 Nov 05 17:41:11 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:12 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" returned: 0 in 0.777s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:12 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a Nov 05 17:41:12 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:12 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372" returned: 0 in 1.153s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0991de6-7902-4659-a308-56045458d18b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb17ba4-4a6d-4731-8000-6fecfb0f4fda]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:12 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b Nov 05 17:41:12 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:13 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b" returned: 0 in 1.204s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:13 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 Nov 05 17:41:13 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:13 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:41:13 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:14 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.822s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:41:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:41:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:41:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:41:14 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372" returned: 0 in 1.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:14 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372 Nov 05 17:41:14 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:15 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b.2a818253-0d2a-418c-9f04-e8df52944372" returned: 0 in 0.715s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-quobyte-2a818253-0d2a-418c-9f04-e8df52944372" released by "_delete_snapshot" :: held 4.702s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-quobyte-f0991de6-7902-4659-a308-56045458d18b" released by "delete_snapshot" :: held 4.791s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Created reservations ['dfc62670-6cfd-4cb1-b2db-93042e3677b2', '09351aab-e0ed-40a5-8ba8-738a09a75eeb', 'ee67685e-76f1-4228-a1e9-bedfc08fa151', '1d0d767f-5d36-4770-a065-f90859196a66'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:41:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Delete snapshot completed successfully. Nov 05 17:41:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab9e9740-2209-4434-8765-50ca1e6291b5 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-2a818253-0d2a-418c-9f04-e8df52944372-delete_snapshot" released by "delete_snapshot" :: held 5.533s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "cinder-f0991de6-7902-4659-a308-56045458d18b-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-f0991de6-7902-4659-a308-56045458d18b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:17 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=105,cinder:INSERT=37,cinder:UPDATE=115,cinder:DELETE=9 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:41:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "cinder-quobyte-f0991de6-7902-4659-a308-56045458d18b" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-quobyte-f0991de6-7902-4659-a308-56045458d18b" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eec1140-5207-424d-973e-70da5a35c20c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:18 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b Nov 05 17:41:18 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:19 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b" returned: 0 in 1.704s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:19 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b Nov 05 17:41:19 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:20 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f0991de6-7902-4659-a308-56045458d18b" returned: 0 in 0.755s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-quobyte-f0991de6-7902-4659-a308-56045458d18b" released by "delete_volume" :: held 2.781s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Created reservations ['fd13e67c-1575-4338-b15f-f41c474f969c', 'e435cd82-c78a-47cc-a6a7-e22ae24e425a', 'd6804f39-1b61-4fee-b0bb-6b586f59a6ea', 'cde1bd5f-f39e-4ae1-806e-c43de07a91b1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:20 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:41:20 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:21 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.450s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:41:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Deleted volume successfully. Nov 05 17:41:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de13c68d-19ec-4c3c-8215-54f894464401 tempest-VolumesSnapshotNegativeTestJSON-846709400 None] Lock "cinder-f0991de6-7902-4659-a308-56045458d18b-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-d0cfce8c-b830-4163-b615-7d9beb46aa9b req-29424e8e-45f2-4411-9959-26196e9a26ea tempest-AttachVolumeNegativeTest-2082876409 None] Terminate volume connection completed successfully. Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-d0cfce8c-b830-4163-b615-7d9beb46aa9b req-29424e8e-45f2-4411-9959-26196e9a26ea tempest-AttachVolumeNegativeTest-2082876409 None] Deleting attachment 7f649554-a61d-4356-923b-74cbe42fda89. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:41:25 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" returned: 0 in 13.457s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333, size 1024.00 MB, duration 13.46 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:41:25 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Converted 1024.00 MB image at 76.07 MB/s Nov 05 17:41:25 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a is being set with open permissions: ugo+rw Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:25 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a Nov 05 17:41:25 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:25 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" released by "_copy_volume_from_snapshot" :: held 15.340s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-aa55364e-aecc-40fd-90e2-69e1b68a9c8f-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" released by "_create_volume_from_snapshot" :: held 15.486s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.554s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10da4c7-e81c-4f53-bf43-594b509d08b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a', 'volume_size': 1, 'snapshot_id': 'aa55364e-aecc-40fd-90e2-69e1b68a9c8f'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9b4a0f-b1fa-477e-9702-5babffe981a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Volume volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a (714b2371-1cb9-4430-b4d7-7c5d77e4da2a): created successfully Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9b4a0f-b1fa-477e-9702-5babffe981a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Flow 'volume_create_manager' (2f523b69-76b0-4f2d-8e2b-dd742317f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0c66b5b3-0c20-47e2-99d0-4e76a6218c9b tempest-VolumesDeleteCascade-1005037547 None] Created volume successfully. Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-1d5daa7e-7ee8-4520-b45e-a0e23fa73333-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-1d5daa7e-7ee8-4520-b45e-a0e23fa73333-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Performing cascade delete. {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-aa55364e-aecc-40fd-90e2-69e1b68a9c8f-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-aa55364e-aecc-40fd-90e2-69e1b68a9c8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" acquired by "delete_snapshot" :: waited 0.102s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-aa55364e-aecc-40fd-90e2-69e1b68a9c8f" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-aa55364e-aecc-40fd-90e2-69e1b68a9c8f" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Deleting offline snapshot aa55364e-aecc-40fd-90e2-69e1b68a9c8f of volume 1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] snapshot_file for this snap is: volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b905b503-8f9f-4602-b8fa-672a9c747678]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:27 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f Nov 05 17:41:27 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:27 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f" returned: 0 in 0.793s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:41:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[782d01ac-594f-41f9-9b90-e86067af93c5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:28 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 Nov 05 17:41:28 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Flow 'volume_create_manager' (f5206d1c-187d-45c8-aaf2-a4a81f7e9cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aa15bf-5dca-40d6-91e6-b77a2a1da2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aa15bf-5dca-40d6-91e6-b77a2a1da2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138713617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b930f674-e6d8-4435-b2fd-9b9854a352f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38f22deaff84287bb3357261121503c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:28Z,use_quota=True,user_id='54b9e276554440db8b5352b68b4f49e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e58449-c225-4a23-9d3a-382321314e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e58449-c225-4a23-9d3a-382321314e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e225cfe9-70b7-4ff6-9681-c99e2269d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e225cfe9-70b7-4ff6-9681-c99e2269d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b930f674-e6d8-4435-b2fd-9b9854a352f7', 'volume_name': 'volume-b930f674-e6d8-4435-b2fd-9b9854a352f7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289fd9c9-5a09-4a49-a71d-14a3d9e429a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289fd9c9-5a09-4a49-a71d-14a3d9e429a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fd18fc-9652-47e5-8e07-eae7a1799eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Volume b930f674-e6d8-4435-b2fd-9b9854a352f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b930f674-e6d8-4435-b2fd-9b9854a352f7', 'volume_size': 1} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138713617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b930f674-e6d8-4435-b2fd-9b9854a352f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38f22deaff84287bb3357261121503c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:28Z,use_quota=True,user_id='54b9e276554440db8b5352b68b4f49e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Creating volume b930f674-e6d8-4435-b2fd-9b9854a352f7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:41:28 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:28 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 1073741824 Nov 05 17:41:28 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:28 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" returned: 0 in 1.076s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:28 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f Nov 05 17:41:28 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:29 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 1073741824" returned: 0 in 0.929s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:29 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 Nov 05 17:41:29 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:29 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f" returned: 0 in 0.690s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:29 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f Nov 05 17:41:29 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:29 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7" returned: 0 in 0.381s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:29 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333.aa55364e-aecc-40fd-90e2-69e1b68a9c8f" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-aa55364e-aecc-40fd-90e2-69e1b68a9c8f" released by "_delete_snapshot" :: held 3.195s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fd18fc-9652-47e5-8e07-eae7a1799eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b930f674-e6d8-4435-b2fd-9b9854a352f7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a253a4c-e52b-4e3a-a7ca-458a484a55f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" released by "delete_snapshot" :: held 3.270s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Volume volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 (b930f674-e6d8-4435-b2fd-9b9854a352f7): created successfully Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a253a4c-e52b-4e3a-a7ca-458a484a55f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Flow 'volume_create_manager' (f5206d1c-187d-45c8-aaf2-a4a81f7e9cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f0236deb-7329-41f6-9b4f-6e3b73d22b0b tempest-ServersNegativeTestJSON-713051306 None] Created volume successfully. Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Created reservations ['cc03db61-c874-407f-8e80-7993f9dda761', '77f014bb-3f37-4a19-85b9-83a5c38d3e54', '58185ed3-8c73-461f-8b2e-feea5fe2df3d', '1c99cfb1-5c6f-496b-8fc5-3bdaddeea30e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:41:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Delete snapshot completed successfully. Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-aa55364e-aecc-40fd-90e2-69e1b68a9c8f-delete_snapshot" released by "delete_snapshot" :: held 3.597s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Snapshots deleted, issuing volume delete {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9058425c-8b66-46ee-8627-3515a9b30653]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:30 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 Nov 05 17:41:30 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:30 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" returned: 0 in 0.543s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:30 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333 Nov 05 17:41:30 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:31 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" returned: 0 in 0.452s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-1d5daa7e-7ee8-4520-b45e-a0e23fa73333" released by "delete_volume" :: held 1.133s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Created reservations ['e3a1b7bc-5748-4c63-aa90-dd8fdc0c62a7', '5d73f063-6d1f-4907-a503-43eeb3d3ebb9', 'c6457c5e-1cd3-4b1d-ac2e-a8eca2bb04eb', '24aa83b2-8e1b-4c6c-845d-f297dc4d626a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:31 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:41:31 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:31 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.296s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:41:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Deleted volume successfully. Nov 05 17:41:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1546e9f0-d3e3-4839-91da-181dae7c5e19 tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-1d5daa7e-7ee8-4520-b45e-a0e23fa73333-delete_volume" released by "delete_volume" :: held 5.356s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-714b2371-1cb9-4430-b4d7-7c5d77e4da2a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-714b2371-1cb9-4430-b4d7-7c5d77e4da2a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "cinder-quobyte-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b389e-e5d5-4f31-b564-837e1d8d1091]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:32 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a Nov 05 17:41:32 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Flow 'volume_create_manager' (cedf3337-05f3-447e-b51f-f5dfc8bc100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3809ca6-8c14-474e-9ffc-8a200442a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3809ca6-8c14-474e-9ffc-8a200442a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1093677554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c862de5a-c458-411f-90e2-f1e10684b561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38f22deaff84287bb3357261121503c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:33Z,use_quota=True,user_id='54b9e276554440db8b5352b68b4f49e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a72d51d-9c67-4a2d-b16d-0005d66eaaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a72d51d-9c67-4a2d-b16d-0005d66eaaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd661f16-a51d-49dc-8d8b-0f1c1eb178e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd661f16-a51d-49dc-8d8b-0f1c1eb178e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c862de5a-c458-411f-90e2-f1e10684b561', 'volume_name': 'volume-c862de5a-c458-411f-90e2-f1e10684b561', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ed17ef-5f8e-45c2-b1f3-dcb5c9d2047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ed17ef-5f8e-45c2-b1f3-dcb5c9d2047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a0a001-ea30-4315-a61d-dda847118388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Volume c862de5a-c458-411f-90e2-f1e10684b561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c862de5a-c458-411f-90e2-f1e10684b561', 'volume_size': 1} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1093677554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c862de5a-c458-411f-90e2-f1e10684b561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38f22deaff84287bb3357261121503c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:33Z,use_quota=True,user_id='54b9e276554440db8b5352b68b4f49e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Creating volume c862de5a-c458-411f-90e2-f1e10684b561 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:41:32 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:32 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 1073741824 Nov 05 17:41:32 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:32 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" returned: 0 in 0.480s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:33 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a Nov 05 17:41:33 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:33 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 1073741824" returned: 0 in 0.536s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:33 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-quobyte-714b2371-1cb9-4430-b4d7-7c5d77e4da2a" released by "delete_volume" :: held 0.986s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:33 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 Nov 05 17:41:33 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Created reservations ['80099b50-de29-4a97-b598-b2c12a18819a', '2e97467d-a727-4161-b627-55e7458e8dce', '380bae0d-7755-4530-aece-ff0d50bcca08', 'c439239d-15b3-4220-b249-60cd82d3c2d1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:33 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:41:33 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:33 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a0a001-ea30-4315-a61d-dda847118388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c862de5a-c458-411f-90e2-f1e10684b561', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edc0d36-5a0d-4967-9cb3-9b990b06b3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Volume volume-c862de5a-c458-411f-90e2-f1e10684b561 (c862de5a-c458-411f-90e2-f1e10684b561): created successfully Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edc0d36-5a0d-4967-9cb3-9b990b06b3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Flow 'volume_create_manager' (cedf3337-05f3-447e-b51f-f5dfc8bc100e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8dbcf5a8-c467-4917-a4c2-ca57f61676e2 tempest-ServersNegativeTestJSON-713051306 None] Created volume successfully. Nov 05 17:41:33 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.319s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:33 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:41:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Deleted volume successfully. Nov 05 17:41:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b8d6742b-baed-4b1f-b4ee-600dfc3d05aa tempest-VolumesDeleteCascade-1005037547 None] Lock "cinder-714b2371-1cb9-4430-b4d7-7c5d77e4da2a-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "cinder-c862de5a-c458-411f-90e2-f1e10684b561-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-c862de5a-c458-411f-90e2-f1e10684b561-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "cinder-quobyte-c862de5a-c458-411f-90e2-f1e10684b561" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-quobyte-c862de5a-c458-411f-90e2-f1e10684b561" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c5446a-e129-4c9f-906c-38fb8040cfc8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:36 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 Nov 05 17:41:36 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:36 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561" returned: 0 in 0.423s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:36 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561 Nov 05 17:41:36 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:37 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c862de5a-c458-411f-90e2-f1e10684b561" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-quobyte-c862de5a-c458-411f-90e2-f1e10684b561" released by "delete_volume" :: held 0.810s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Created reservations ['f0f47864-a908-4d47-a342-ffb25814cb4b', 'cb2b7050-c12f-4ac1-a9ea-f48737c3a161', '3ecc42db-53d7-40db-a29d-40cca10a91ef', '95e46949-214b-4d2e-ac92-13c343b8239b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:37 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:41:37 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "cinder-b930f674-e6d8-4435-b2fd-9b9854a352f7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-b930f674-e6d8-4435-b2fd-9b9854a352f7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "cinder-quobyte-b930f674-e6d8-4435-b2fd-9b9854a352f7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-quobyte-b930f674-e6d8-4435-b2fd-9b9854a352f7" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[709ad29a-5cf6-4331-af34-1439a11f2699]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:41:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:37 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.528s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:41:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Deleted volume successfully. Nov 05 17:41:38 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 Nov 05 17:41:38 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-916b49b1-0425-4dcf-a5e5-c0e2a6f76d5a tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-c862de5a-c458-411f-90e2-f1e10684b561-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:38 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7" returned: 0 in 0.627s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:38 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7 Nov 05 17:41:38 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:38 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b930f674-e6d8-4435-b2fd-9b9854a352f7" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-quobyte-b930f674-e6d8-4435-b2fd-9b9854a352f7" released by "delete_volume" :: held 1.084s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Created reservations ['3c044451-1dbc-4806-b052-4e27584f6744', '82fe142d-c4e8-4d60-9369-4974474060e0', '2bcfa24f-9259-4925-94af-cfa4e1f35e31', 'a6dfd8ea-0b5b-4aa0-bb30-7db2ce37d54b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:39 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:41:39 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:39 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:41:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Deleted volume successfully. Nov 05 17:41:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-63aaed92-f8c5-4b6d-b24c-240de846e52c tempest-ServersNegativeTestJSON-713051306 None] Lock "cinder-b930f674-e6d8-4435-b2fd-9b9854a352f7-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:41:49 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=64,cinder:INSERT=18,cinder:DELETE=8,cinder:SELECT=53 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:41:49 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=39,cinder:INSERT=13,cinder:UPDATE=54,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Flow 'volume_create_manager' (2d6f6041-5fc9-4369-8bcb-52a75ae44ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3369ff4-4a73-4d6a-b50d-7499c25d646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3369ff4-4a73-4d6a-b50d-7499c25d646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1018783203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e410ab16-3d17-47a6-809f-a68d06bf02e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cd253d864f42f6bf2b1b2d14863f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:52Z,use_quota=True,user_id='8f27a905961b48cc8fed316919f23755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b947745-6503-43c4-8715-10b43ade2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b947745-6503-43c4-8715-10b43ade2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c59cdf6-b856-4cb2-82f3-e4a8cfb003a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c59cdf6-b856-4cb2-82f3-e4a8cfb003a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e410ab16-3d17-47a6-809f-a68d06bf02e8', 'volume_name': 'volume-e410ab16-3d17-47a6-809f-a68d06bf02e8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0590058-91fa-4dd5-afb3-16458b84e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0590058-91fa-4dd5-afb3-16458b84e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1dcbc4-d11c-485b-bd39-f43332df027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Volume e410ab16-3d17-47a6-809f-a68d06bf02e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e410ab16-3d17-47a6-809f-a68d06bf02e8', 'volume_size': 1} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1018783203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e410ab16-3d17-47a6-809f-a68d06bf02e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cd253d864f42f6bf2b1b2d14863f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:41:52Z,use_quota=True,user_id='8f27a905961b48cc8fed316919f23755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Creating volume e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:41:52 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:41:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:52 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 1073741824 Nov 05 17:41:52 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:53 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 1073741824" returned: 0 in 0.685s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:41:53 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:41:53 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:41:53 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1dcbc4-d11c-485b-bd39-f43332df027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e410ab16-3d17-47a6-809f-a68d06bf02e8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e330b3fa-b741-4a29-9481-af9a41634f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:41:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Volume volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 (e410ab16-3d17-47a6-809f-a68d06bf02e8): created successfully Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e330b3fa-b741-4a29-9481-af9a41634f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:41:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Flow 'volume_create_manager' (2d6f6041-5fc9-4369-8bcb-52a75ae44ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:41:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-81f970f2-bb1b-4a59-a04c-3fdc773df3ad tempest-VolumesActionsTest-62414745 None] Created volume successfully. Nov 05 17:42:03 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:42:03 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:42:05 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Flow 'volume_create_manager' (17659d7c-f679-4a70-bcd8-d07534c2f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537399ab-ceae-4637-a320-f26a7713299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537399ab-ceae-4637-a320-f26a7713299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-791602022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506fe5df-ed05-4a41-b5d4-4e5254d81baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd64d28e9504b8fa221f38e9f568d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:06Z,use_quota=True,user_id='5e5b8d4dfd594d06a31d4736bd082ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26ea2793-ed43-4d5d-8ee1-30374ff56c7d),volume_type_id=26ea2793-ed43-4d5d-8ee1-30374ff56c7d)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaebf7b-e10a-46e4-954f-410ace444a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaebf7b-e10a-46e4-954f-410ace444a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59914045-a3d6-40f5-bb72-ceabfbffa253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59914045-a3d6-40f5-bb72-ceabfbffa253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506fe5df-ed05-4a41-b5d4-4e5254d81baa', 'volume_name': 'volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f43383d-8a4a-4205-8722-a0713251c23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f43383d-8a4a-4205-8722-a0713251c23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2a0fe8-66b1-4ce2-8b95-dbefee73c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Volume 506fe5df-ed05-4a41-b5d4-4e5254d81baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa', 'volume_size': 1} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-791602022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506fe5df-ed05-4a41-b5d4-4e5254d81baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd64d28e9504b8fa221f38e9f568d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:06Z,use_quota=True,user_id='5e5b8d4dfd594d06a31d4736bd082ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26ea2793-ed43-4d5d-8ee1-30374ff56c7d),volume_type_id=26ea2793-ed43-4d5d-8ee1-30374ff56c7d)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Creating volume 506fe5df-ed05-4a41-b5d4-4e5254d81baa {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:42:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:06 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa 1073741824 Nov 05 17:42:06 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Flow 'volume_create_manager' (a2088827-18ad-4540-8691-29a7f5f696ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f993f2c-c096-40db-af71-e1e66da4cf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f993f2c-c096-40db-af71-e1e66da4cf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1768715478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5fddb0-1a97-4f78-96e2-ecb25edea234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd64d28e9504b8fa221f38e9f568d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:07Z,use_quota=True,user_id='5e5b8d4dfd594d06a31d4736bd082ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee78f92e-f1d3-4907-ab3f-4f6e1711c70f),volume_type_id=ee78f92e-f1d3-4907-ab3f-4f6e1711c70f)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4a7cbd-e360-414a-b462-caf097b4e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4a7cbd-e360-414a-b462-caf097b4e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fcad5a-989d-4efb-ab98-0401e71a24c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fcad5a-989d-4efb-ab98-0401e71a24c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5fddb0-1a97-4f78-96e2-ecb25edea234', 'volume_name': 'volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd9ce0d-3c8b-4cde-929c-e1d0b20a46a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd9ce0d-3c8b-4cde-929c-e1d0b20a46a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a8127d-9b37-4ae9-b1a5-8508a378bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Volume 9f5fddb0-1a97-4f78-96e2-ecb25edea234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234', 'volume_size': 1} Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:06 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa 1073741824" returned: 0 in 0.820s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:07 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa Nov 05 17:42:07 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:07 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1768715478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5fddb0-1a97-4f78-96e2-ecb25edea234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd64d28e9504b8fa221f38e9f568d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:07Z,use_quota=True,user_id='5e5b8d4dfd594d06a31d4736bd082ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee78f92e-f1d3-4907-ab3f-4f6e1711c70f),volume_type_id=ee78f92e-f1d3-4907-ab3f-4f6e1711c70f)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Creating volume 9f5fddb0-1a97-4f78-96e2-ecb25edea234 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:42:07 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2a0fe8-66b1-4ce2-8b95-dbefee73c076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f5ed80-390b-4bd9-9833-e86b19bc4ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Volume volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa (506fe5df-ed05-4a41-b5d4-4e5254d81baa): created successfully Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f5ed80-390b-4bd9-9833-e86b19bc4ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:07 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 1073741824 Nov 05 17:42:07 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Flow 'volume_create_manager' (17659d7c-f679-4a70-bcd8-d07534c2f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a63404b2-eb0a-40e4-98e1-f405deea1b84 tempest-TestInstancesWithCinderVolumes-752452603 None] Created volume successfully. Nov 05 17:42:08 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 1073741824" returned: 0 in 0.822s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:08 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 Nov 05 17:42:08 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:08 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234" returned: 0 in 0.522s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a8127d-9b37-4ae9-b1a5-8508a378bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f7463c-af04-4e11-873a-704775ac94aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Volume volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 (9f5fddb0-1a97-4f78-96e2-ecb25edea234): created successfully Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f7463c-af04-4e11-873a-704775ac94aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Flow 'volume_create_manager' (a2088827-18ad-4540-8691-29a7f5f696ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bb568877-539b-4b0f-9d67-9c91c1f27e12 tempest-TestInstancesWithCinderVolumes-752452603 None] Created volume successfully. Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Flow 'volume_create_manager' (ef0fd0b8-628b-4fb3-97bf-a142eca67b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d49de68-131a-4a66-a77f-b13e43c4b54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d49de68-131a-4a66-a77f-b13e43c4b54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-140550677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd64d28e9504b8fa221f38e9f568d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:09Z,use_quota=True,user_id='5e5b8d4dfd594d06a31d4736bd082ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7765a7d-8171-4ada-83df-64f986f81075),volume_type_id=e7765a7d-8171-4ada-83df-64f986f81075)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162186c9-1870-4390-8df3-346fb4b1171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162186c9-1870-4390-8df3-346fb4b1171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3936a46-014b-4087-a722-a8fe0024d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:09 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:42:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3936a46-014b-4087-a722-a8fe0024d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21', 'volume_name': 'volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21', 'volume_size': 1, 'image_id': '50445b74-dd69-4eb3-9cd8-f6e902966072', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50445b74-dd69-4eb3-9cd8-f6e902966072', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1420487717', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cfd64d28e9504b8fa221f38e9f568d37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '50445b74-dd69-4eb3-9cd8-f6e902966072', 'created_at': datetime.datetime(2026, 11, 5, 16, 42, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 42, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50445b74-dd69-4eb3-9cd8-f6e902966072/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498a1cb3-5733-43de-91af-addabbc40158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498a1cb3-5733-43de-91af-addabbc40158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910ce034-7da0-4a85-b919-5a5341512a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:10 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Volume a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21', 'volume_size': 1, 'image_id': '50445b74-dd69-4eb3-9cd8-f6e902966072', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50445b74-dd69-4eb3-9cd8-f6e902966072', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1420487717', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cfd64d28e9504b8fa221f38e9f568d37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '50445b74-dd69-4eb3-9cd8-f6e902966072', 'created_at': datetime.datetime(2026, 11, 5, 16, 42, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 42, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50445b74-dd69-4eb3-9cd8-f6e902966072/file', 'properties': {}}, 'image_service': } Nov 05 17:42:10 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Trying to clone a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 from image 50445b74-dd69-4eb3-9cd8-f6e902966072 at location (None, [{'url': 'file:///opt/stack/data/glance/images/50445b74-dd69-4eb3-9cd8-f6e902966072', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:42:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-51e459d2-7f93-45a7-b9c5-fa0177d7c73e tempest-VolumesActionsTest-62414745 None] Acquiring lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8" by "attach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:42:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-51e459d2-7f93-45a7-b9c5-fa0177d7c73e tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8" acquired by "attach_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:42:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-51e459d2-7f93-45a7-b9c5-fa0177d7c73e tempest-VolumesActionsTest-62414745 None] Attaching volume e410ab16-3d17-47a6-809f-a68d06bf02e8 to instance 04ef59cc-d311-4f16-89be-a79f97174eb8 at mountpoint /dev/vdb on host None. Nov 05 17:42:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-51e459d2-7f93-45a7-b9c5-fa0177d7c73e tempest-VolumesActionsTest-62414745 None] Attach volume completed successfully. Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-51e459d2-7f93-45a7-b9c5-fa0177d7c73e tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8" released by "attach_volume" :: held 0.143s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ec3b48b-5f29-43b4-946c-9ec9aa82b482 tempest-VolumesActionsTest-62414745 None] Acquiring lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ec3b48b-5f29-43b4-946c-9ec9aa82b482 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:42:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4ec3b48b-5f29-43b4-946c-9ec9aa82b482 tempest-VolumesActionsTest-62414745 None] Detaching volume e410ab16-3d17-47a6-809f-a68d06bf02e8 from instance 04ef59cc-d311-4f16-89be-a79f97174eb8. Nov 05 17:42:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4ec3b48b-5f29-43b4-946c-9ec9aa82b482 tempest-VolumesActionsTest-62414745 None] Detach volume completed successfully. Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ec3b48b-5f29-43b4-946c-9ec9aa82b482 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:13 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:42:13 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:14 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:42:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:42:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:42:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:42:15 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD, size 20.69 MB, duration 5.36 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:42:15 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Image download 20.69 MB at 3.86 MB/s Nov 05 17:42:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fecf446-262f-4db6-ba97-9b4127d12489]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:42:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:15 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD Nov 05 17:42:15 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:16 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Temporary image 50445b74-dd69-4eb3-9cd8-f6e902966072 is fetched for user 5e5b8d4dfd594d06a31d4736bd082ba4. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43d1f1f-1c87-4fbb-a19c-7428432390f2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:16 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD Nov 05 17:42:16 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:16 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-140550677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd64d28e9504b8fa221f38e9f568d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:09Z,use_quota=True,user_id='5e5b8d4dfd594d06a31d4736bd082ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7765a7d-8171-4ada-83df-64f986f81075),volume_type_id=e7765a7d-8171-4ada-83df-64f986f81075)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Creating volume a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:42:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:42:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:16 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 1073741824 Nov 05 17:42:16 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:17 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 1073741824" returned: 0 in 0.641s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:17 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 Nov 05 17:42:17 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:17 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21" returned: 0 in 0.421s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Attempting download of 50445b74-dd69-4eb3-9cd8-f6e902966072 ((None, [{'url': 'file:///opt/stack/data/glance/images/50445b74-dd69-4eb3-9cd8-f6e902966072', 'metadata': {}}])) to volume a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a1d9d4-be4c-4e58-bcb5-e9de35b96162]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:42:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50445b74-dd69-4eb3-9cd8-f6e902966072_zxvbseu4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:18 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50445b74-dd69-4eb3-9cd8-f6e902966072_zxvbseu4 Nov 05 17:42:18 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:18 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50445b74-dd69-4eb3-9cd8-f6e902966072_zxvbseu4" returned: 0 in 0.478s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50445b74-dd69-4eb3-9cd8-f6e902966072_zxvbseu4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:18 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50445b74-dd69-4eb3-9cd8-f6e902966072_zxvbseu4 Nov 05 17:42:18 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:18 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50445b74-dd69-4eb3-9cd8-f6e902966072_zxvbseu4" returned: 1 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50445b74-dd69-4eb3-9cd8-f6e902966072_zxvbseu4' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:42:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9673fb-bdce-40ee-8bbe-9b3d8f991bf0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:42:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:18 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD Nov 05 17:42:18 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:19 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:19 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] 50445b74-dd69-4eb3-9cd8-f6e902966072 was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:42:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:19 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 Nov 05 17:42:19 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:21 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21" returned: 0 in 2.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:21 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_50445b74-dd69-4eb3-9cd8-f6e902966072_b2ytgqh4devstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:42:21 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Converted 112.00 MB image at 43.15 MB/s Nov 05 17:42:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:21 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 1G Nov 05 17:42:21 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:22 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 1G" returned: 0 in 0.448s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Downloaded image 50445b74-dd69-4eb3-9cd8-f6e902966072 ((None, [{'url': 'file:///opt/stack/data/glance/images/50445b74-dd69-4eb3-9cd8-f6e902966072', 'metadata': {}}])) to volume a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Temporary image 50445b74-dd69-4eb3-9cd8-f6e902966072 for user 5e5b8d4dfd594d06a31d4736bd082ba4 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Marking volume a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Copying metadata from image 50445b74-dd69-4eb3-9cd8-f6e902966072 to a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Creating volume glance metadata for volume a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 backed by image 50445b74-dd69-4eb3-9cd8-f6e902966072 with: {'image_id': '50445b74-dd69-4eb3-9cd8-f6e902966072', 'image_name': 'tempest-scenario-img--1420487717', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910ce034-7da0-4a85-b919-5a5341512a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21', 'volume_size': 1, 'image_id': '50445b74-dd69-4eb3-9cd8-f6e902966072', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50445b74-dd69-4eb3-9cd8-f6e902966072', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1420487717', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cfd64d28e9504b8fa221f38e9f568d37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '50445b74-dd69-4eb3-9cd8-f6e902966072', 'created_at': datetime.datetime(2026, 11, 5, 16, 42, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 42, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50445b74-dd69-4eb3-9cd8-f6e902966072/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b48cac-591f-4a0e-aacf-1d2dcc241341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Volume volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 (a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21): created successfully Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b48cac-591f-4a0e-aacf-1d2dcc241341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Flow 'volume_create_manager' (ef0fd0b8-628b-4fb3-97bf-a142eca67b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-96759730-1216-4d68-87e4-9ca3134bc32b tempest-TestInstancesWithCinderVolumes-752452603 None] Created volume successfully. Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Flow 'volume_create_manager' (bf7de296-b85b-479e-b6ce-57ab339b6a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13e58d5-626d-4d90-9e86-6c8324b8740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13e58d5-626d-4d90-9e86-6c8324b8740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-743030397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdca264-4d94-4127-9016-457702813a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b87c0c7fc64dd79e40dd33fe72c8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:26Z,use_quota=True,user_id='d9c03fb02dcc42b9bca12f52a3b64413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1d18a5-77f9-45c9-86d0-c01b9461f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1d18a5-77f9-45c9-86d0-c01b9461f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43c39e4-c19c-4c02-b6c0-ff5d07e7744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43c39e4-c19c-4c02-b6c0-ff5d07e7744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdca264-4d94-4127-9016-457702813a8f', 'volume_name': 'volume-7cdca264-4d94-4127-9016-457702813a8f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae235b4b-b8bc-4f8c-b9ba-f067f8906806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae235b4b-b8bc-4f8c-b9ba-f067f8906806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f905089-b9d6-49b4-98fc-e5f65dcb0b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Volume 7cdca264-4d94-4127-9016-457702813a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdca264-4d94-4127-9016-457702813a8f', 'volume_size': 1} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-743030397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdca264-4d94-4127-9016-457702813a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b87c0c7fc64dd79e40dd33fe72c8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:42:26Z,use_quota=True,user_id='d9c03fb02dcc42b9bca12f52a3b64413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Creating volume 7cdca264-4d94-4127-9016-457702813a8f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:42:25 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:42:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:25 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f 1073741824 Nov 05 17:42:25 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:27 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f 1073741824" returned: 0 in 1.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:27 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f Nov 05 17:42:27 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:27 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f" returned: 0 in 0.689s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:42:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f905089-b9d6-49b4-98fc-e5f65dcb0b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdca264-4d94-4127-9016-457702813a8f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260538bb-af05-441e-bb87-5a4b2bfe021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:42:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Volume volume-7cdca264-4d94-4127-9016-457702813a8f (7cdca264-4d94-4127-9016-457702813a8f): created successfully Nov 05 17:42:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260538bb-af05-441e-bb87-5a4b2bfe021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:42:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Flow 'volume_create_manager' (bf7de296-b85b-479e-b6ce-57ab339b6a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:42:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3e2ed0b5-0686-4647-9554-5ffbcbc90d5b tempest-AttachVolumeNegativeTest-2082876409 None] Created volume successfully. Nov 05 17:42:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-1da848c6-adf1-4e69-a371-3b320751efd5 req-1d6e0e12-8f86-42f8-a240-fbfec4e1ddbf tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-1da848c6-adf1-4e69-a371-3b320751efd5 req-1d6e0e12-8f86-42f8-a240-fbfec4e1ddbf tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-1da848c6-adf1-4e69-a371-3b320751efd5 req-1d6e0e12-8f86-42f8-a240-fbfec4e1ddbf tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-1da848c6-adf1-4e69-a371-3b320751efd5 req-1d6e0e12-8f86-42f8-a240-fbfec4e1ddbf tempest-TestInstancesWithCinderVolumes-752452603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbd09835-6959-4b71-b1f1-87d35eacbb84', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:42:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-1da848c6-adf1-4e69-a371-3b320751efd5 req-1d6e0e12-8f86-42f8-a240-fbfec4e1ddbf tempest-TestInstancesWithCinderVolumes-752452603 None] attachment_update completed successfully. Nov 05 17:42:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-950f0f5c-cebd-4597-919f-d0ff71f90e91 tempest-VolumesActionsTest-62414745 None] Acquiring lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8" by "attach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:42:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a1ab967b-72df-4c45-a22d-c9728a8e670a req-258af0b6-5a0b-4e31-aa53-33a89742bac0 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a1ab967b-72df-4c45-a22d-c9728a8e670a req-258af0b6-5a0b-4e31-aa53-33a89742bac0 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-950f0f5c-cebd-4597-919f-d0ff71f90e91 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8" acquired by "attach_volume" :: waited 0.057s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:42:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a1ab967b-72df-4c45-a22d-c9728a8e670a req-258af0b6-5a0b-4e31-aa53-33a89742bac0 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:42:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-a1ab967b-72df-4c45-a22d-c9728a8e670a req-258af0b6-5a0b-4e31-aa53-33a89742bac0 tempest-AttachVolumeNegativeTest-2082876409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-7cdca264-4d94-4127-9016-457702813a8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c1f6819-2322-40b7-8274-0b74187c8f77', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:42:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-950f0f5c-cebd-4597-919f-d0ff71f90e91 tempest-VolumesActionsTest-62414745 None] Attaching volume e410ab16-3d17-47a6-809f-a68d06bf02e8 to instance c97331bf-aed9-49e8-ba32-74c6c74fa4c0 at mountpoint /dev/vdb on host None. Nov 05 17:42:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-950f0f5c-cebd-4597-919f-d0ff71f90e91 tempest-VolumesActionsTest-62414745 None] Attach volume completed successfully. Nov 05 17:42:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-950f0f5c-cebd-4597-919f-d0ff71f90e91 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8" released by "attach_volume" :: held 0.279s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:42:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-a1ab967b-72df-4c45-a22d-c9728a8e670a req-258af0b6-5a0b-4e31-aa53-33a89742bac0 tempest-AttachVolumeNegativeTest-2082876409 None] attachment_update completed successfully. Nov 05 17:42:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ade9859-cf71-4a46-984a-4470c9c0c542 tempest-VolumesActionsTest-62414745 None] Acquiring lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:42:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ade9859-cf71-4a46-984a-4470c9c0c542 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:42:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2ade9859-cf71-4a46-984a-4470c9c0c542 tempest-VolumesActionsTest-62414745 None] Detaching volume e410ab16-3d17-47a6-809f-a68d06bf02e8 from instance c97331bf-aed9-49e8-ba32-74c6c74fa4c0. Nov 05 17:42:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2ade9859-cf71-4a46-984a-4470c9c0c542 tempest-VolumesActionsTest-62414745 None] Detach volume completed successfully. Nov 05 17:42:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ade9859-cf71-4a46-984a-4470c9c0c542 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:42:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-9ad4e227-928a-4d84-ba54-45c27f57b261 req-53d014b4-3704-4f01-a33d-6601c1d1331e tempest-AttachVolumeNegativeTest-2082876409 None] Terminate volume connection completed successfully. Nov 05 17:42:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-9ad4e227-928a-4d84-ba54-45c27f57b261 req-53d014b4-3704-4f01-a33d-6601c1d1331e tempest-AttachVolumeNegativeTest-2082876409 None] Deleting attachment 5c1f6819-2322-40b7-8274-0b74187c8f77. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:42:41 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=24,cinder:SELECT=36,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:42:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:42:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:42:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7452f36d-fdc7-47f7-adb6-96c78426e7a5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:42:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:42 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:42:42 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:42 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.694s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[31290db8-9b12-40c6-bf9b-5177c5bd77c9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:42:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:43 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:42:43 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:43 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.828s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.fc035e4b-7418-48f6-98d7-331c518a0bdbv72vv7v0.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:43 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.fc035e4b-7418-48f6-98d7-331c518a0bdbv72vv7v0.img Nov 05 17:42:43 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:52 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=47,cinder:UPDATE=22,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:42:55 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.fc035e4b-7418-48f6-98d7-331c518a0bdbv72vv7v0.img" returned: 0 in 12.059s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5436e193-d21a-441e-9f5d-8480c1417cdf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:42:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:42:55 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:42:55 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:42:56 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Nov 05 17:42:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 1.228s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:42:57 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8, size 1024.00 MB, duration 12.06 sec, destination /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.fc035e4b-7418-48f6-98d7-331c518a0bdbv72vv7v0.img {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:42:57 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Converted 1024.00 MB image at 84.91 MB/s Nov 05 17:42:57 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] fc035e4b-7418-48f6-98d7-331c518a0bdb was raw, no need to convert to raw {{(pid=87126) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Flow 'volume_create_manager' (f2cc7274-8054-40f9-bd0f-22cb6857ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ffe33a-13ab-45bd-985e-1ecab654b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ffe33a-13ab-45bd-985e-1ecab654b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-725762509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c79b1c1-acae-49fe-85eb-c35545b4cb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27e5dbf276a4f0aabc3fe5888b37c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:43:04Z,use_quota=True,user_id='d72900c48f3b4d6cbe62f80271a2d5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b539fda6-566f-4ecd-820a-92f3eb026131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b539fda6-566f-4ecd-820a-92f3eb026131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1747c8a0-ace6-4d96-85db-fce8d42d7c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1747c8a0-ace6-4d96-85db-fce8d42d7c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c79b1c1-acae-49fe-85eb-c35545b4cb0e', 'volume_name': 'volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83f6168-b04b-46fd-b94d-248bb542d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83f6168-b04b-46fd-b94d-248bb542d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f17abf-e183-475a-99ec-be992a5fd2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Volume 4c79b1c1-acae-49fe-85eb-c35545b4cb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e', 'volume_size': 1} Nov 05 17:43:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-103755fe-bfdb-4677-92ef-f26fdc17eebe req-9f08d416-56c4-42c6-88ca-8f6fd0853e83 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:13 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:13 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:14 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:43:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:43:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.236s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Uploaded volume to glance image-id: fc035e4b-7418-48f6-98d7-331c518a0bdb. {{(pid=87126) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.587s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-725762509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c79b1c1-acae-49fe-85eb-c35545b4cb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27e5dbf276a4f0aabc3fe5888b37c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:43:04Z,use_quota=True,user_id='d72900c48f3b4d6cbe62f80271a2d5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Creating volume 4c79b1c1-acae-49fe-85eb-c35545b4cb0e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:43:23 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:23 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e 1073741824 Nov 05 17:43:23 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-169c07e7-0e3d-49e7-839f-9be8a42f342e tempest-VolumesActionsTest-62414745 None] Copy volume to image completed successfully. Nov 05 17:43:23 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e 1073741824" returned: 0 in 0.474s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:23 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e Nov 05 17:43:23 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:24 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-103755fe-bfdb-4677-92ef-f26fdc17eebe req-9f08d416-56c4-42c6-88ca-8f6fd0853e83 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.442s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f17abf-e183-475a-99ec-be992a5fd2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c53721-a3ab-4f34-8796-1317641324fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-103755fe-bfdb-4677-92ef-f26fdc17eebe req-9f08d416-56c4-42c6-88ca-8f6fd0853e83 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Volume volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e (4c79b1c1-acae-49fe-85eb-c35545b4cb0e): created successfully Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c53721-a3ab-4f34-8796-1317641324fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Flow 'volume_create_manager' (f2cc7274-8054-40f9-bd0f-22cb6857ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:43:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6025ef78-01ed-4d5f-8e55-0b644bfeb53c tempest-AttachVolumeTestJSON-1966362438 None] Created volume successfully. Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-103755fe-bfdb-4677-92ef-f26fdc17eebe req-9f08d416-56c4-42c6-88ca-8f6fd0853e83 tempest-TestInstancesWithCinderVolumes-752452603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3762c742-5d98-4cd3-808a-9d4ffec98103', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:43:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-103755fe-bfdb-4677-92ef-f26fdc17eebe req-9f08d416-56c4-42c6-88ca-8f6fd0853e83 tempest-TestInstancesWithCinderVolumes-752452603 None] attachment_update completed successfully. Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2035528c-ed6e-4d36-94a8-2daa22f76989]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:24 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:43:24 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:25 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c1da9a-398b-432e-bb8f-da1b91e777c8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:25 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:43:25 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-dae26acf-eb44-43e1-ab16-b8d7c96ee340 req-84c2755e-c15a-4c6d-8856-977d88308f1d tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:25 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:25 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img Nov 05 17:43:25 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e76c6d28-d28b-4bc3-ab1c-83caf32c776e req-29f66d7f-c269-4407-a987-3f6ee2be3db6 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:32 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img" returned: 0 in 6.544s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e525568-1cd4-461e-a7be-95afd95ed4c1]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:32 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:43:32 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:32 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.626s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:43:32 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Converted 1024.00 MB image at 156.46 MB/s Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] 79ad1b1a-4a6f-4288-8f98-3c7e59cd5226 was raw, converting to qcow2 {{(pid=87126) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a54574-5435-44f9-819d-1c21d63bcd44]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:32 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img Nov 05 17:43:32 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:33 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:33 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img Nov 05 17:43:33 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:33 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img" returned: 1 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img /opt/stack/data/cinder/conversion/vol_upload_3pqovfto {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:33 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img /opt/stack/data/cinder/conversion/vol_upload_3pqovfto Nov 05 17:43:33 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:33 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img /opt/stack/data/cinder/conversion/vol_upload_3pqovfto" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Image conversion details: src /opt/stack/data/cinder/conversion/e410ab16-3d17-47a6-809f-a68d06bf02e8.temp_image.79ad1b1a-4a6f-4288-8f98-3c7e59cd5226xzay2ybk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3pqovfto {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:43:33 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[892521f3-bc7a-432f-b39c-c8e4cdb0e6a5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pqovfto {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:33 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pqovfto Nov 05 17:43:33 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:34 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pqovfto" returned: 0 in 0.332s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.650s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Uploaded volume to glance image-id: 79ad1b1a-4a6f-4288-8f98-3c7e59cd5226. {{(pid=87126) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-dae26acf-eb44-43e1-ab16-b8d7c96ee340 req-84c2755e-c15a-4c6d-8856-977d88308f1d tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.049s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-dae26acf-eb44-43e1-ab16-b8d7c96ee340 req-84c2755e-c15a-4c6d-8856-977d88308f1d tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e76c6d28-d28b-4bc3-ab1c-83caf32c776e req-29f66d7f-c269-4407-a987-3f6ee2be3db6 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.951s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-90600dd0-6088-45ff-bec2-964e77882ac6 tempest-VolumesActionsTest-62414745 None] Copy volume to image completed successfully. Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e76c6d28-d28b-4bc3-ab1c-83caf32c776e req-29f66d7f-c269-4407-a987-3f6ee2be3db6 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.084s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-dae26acf-eb44-43e1-ab16-b8d7c96ee340 req-84c2755e-c15a-4c6d-8856-977d88308f1d tempest-AttachVolumeTestJSON-1966362438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e7414fa-5ef3-41a0-825a-a2a3a55623c5', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:43:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-e76c6d28-d28b-4bc3-ab1c-83caf32c776e req-29f66d7f-c269-4407-a987-3f6ee2be3db6 tempest-TestInstancesWithCinderVolumes-752452603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb97e7ae-df69-4b29-a8aa-36ee49829151', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:43:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-dae26acf-eb44-43e1-ab16-b8d7c96ee340 req-84c2755e-c15a-4c6d-8856-977d88308f1d tempest-AttachVolumeTestJSON-1966362438 None] attachment_update completed successfully. Nov 05 17:43:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-e76c6d28-d28b-4bc3-ab1c-83caf32c776e req-29f66d7f-c269-4407-a987-3f6ee2be3db6 tempest-TestInstancesWithCinderVolumes-752452603 None] attachment_update completed successfully. Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Flow 'volume_create_manager' (45315d3e-ee31-41b3-bee9-840b6391540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5168df-1b1b-425c-8fed-56d38afd9061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5168df-1b1b-425c-8fed-56d38afd9061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-867245507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e1d4d-ca85-4f61-b1bc-704f0ac57047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b87c0c7fc64dd79e40dd33fe72c8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:43:36Z,use_quota=True,user_id='d9c03fb02dcc42b9bca12f52a3b64413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae9a1ac-b769-47d5-8461-fe2f0a6e318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae9a1ac-b769-47d5-8461-fe2f0a6e318e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bdcacd-ffe7-42c1-9362-afb24c526bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bdcacd-ffe7-42c1-9362-afb24c526bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4e1d4d-ca85-4f61-b1bc-704f0ac57047', 'volume_name': 'volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0982aae-8e16-4640-b2b2-69aa15aa33a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0982aae-8e16-4640-b2b2-69aa15aa33a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4981a1e-36d3-40b8-9cb9-f24a853c6144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Volume 9b4e1d4d-ca85-4f61-b1bc-704f0ac57047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047', 'volume_size': 1} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-867245507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e1d4d-ca85-4f61-b1bc-704f0ac57047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b87c0c7fc64dd79e40dd33fe72c8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:43:36Z,use_quota=True,user_id='d9c03fb02dcc42b9bca12f52a3b64413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Creating volume 9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:43:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:43:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:36 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 1073741824 Nov 05 17:43:36 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:37 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 1073741824" returned: 0 in 0.560s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Acquiring lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:37 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 Nov 05 17:43:37 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Acquiring lock "cinder-quobyte-e410ab16-3d17-47a6-809f-a68d06bf02e8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Lock "cinder-quobyte-e410ab16-3d17-47a6-809f-a68d06bf02e8" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfa42cf-4f93-4755-ba90-1f2d133164f1]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:37 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:43:37 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:37 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4981a1e-36d3-40b8-9cb9-f24a853c6144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee1e923-a2c3-4f3f-99ac-c03877916361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Volume volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 (9b4e1d4d-ca85-4f61-b1bc-704f0ac57047): created successfully Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee1e923-a2c3-4f3f-99ac-c03877916361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Flow 'volume_create_manager' (45315d3e-ee31-41b3-bee9-840b6391540f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:43:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b463e296-a74a-4c87-ba8a-f19ccbfc9fc1 tempest-AttachVolumeNegativeTest-2082876409 None] Created volume successfully. Nov 05 17:43:37 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.493s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:37 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8 Nov 05 17:43:37 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:38 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e410ab16-3d17-47a6-809f-a68d06bf02e8" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Lock "cinder-quobyte-e410ab16-3d17-47a6-809f-a68d06bf02e8" released by "delete_volume" :: held 0.804s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Created reservations ['360c18de-4421-487c-8979-a23b46181b3b', 'd2fc358b-0247-4d15-8780-0824242e41ea', 'a6c5dc64-c55e-4767-b61b-05eae6176992', 'ecbc51dd-798b-490e-a943-b750a1237b4c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:38 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:38 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:38 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.311s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Deleted volume successfully. Nov 05 17:43:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5aad3d3-2520-4bd9-9cdc-21ba552e1852 tempest-VolumesActionsTest-62414745 None] Lock "cinder-e410ab16-3d17-47a6-809f-a68d06bf02e8-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-915cbcff-18f8-49c8-84e9-f0d6b4f7147a req-c27b186d-5b39-4466-8a4b-884f3a2f6b56 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-915cbcff-18f8-49c8-84e9-f0d6b4f7147a req-c27b186d-5b39-4466-8a4b-884f3a2f6b56 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-915cbcff-18f8-49c8-84e9-f0d6b4f7147a req-c27b186d-5b39-4466-8a4b-884f3a2f6b56 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-915cbcff-18f8-49c8-84e9-f0d6b4f7147a req-c27b186d-5b39-4466-8a4b-884f3a2f6b56 tempest-AttachVolumeNegativeTest-2082876409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd423bfa4-0906-46b3-a2b3-c7a9dafd442d', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:43:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-915cbcff-18f8-49c8-84e9-f0d6b4f7147a req-c27b186d-5b39-4466-8a4b-884f3a2f6b56 tempest-AttachVolumeNegativeTest-2082876409 None] attachment_update completed successfully. Nov 05 17:43:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-2a83bc65-81b2-49ff-95a2-edeb7b30566f req-9f90980c-5b22-40f7-8311-6f9c2e8b033b tempest-TestInstancesWithCinderVolumes-752452603 None] Terminate volume connection completed successfully. Nov 05 17:43:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-2a83bc65-81b2-49ff-95a2-edeb7b30566f req-9f90980c-5b22-40f7-8311-6f9c2e8b033b tempest-TestInstancesWithCinderVolumes-752452603 None] Deleting attachment 3762c742-5d98-4cd3-808a-9d4ffec98103. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:43:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "cinder-506fe5df-ed05-4a41-b5d4-4e5254d81baa-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-6b2e365c-169d-4d50-9b30-330646bd3085 req-eef5b87d-5108-4eb3-94f5-1d15b8bfd889 tempest-AttachVolumeNegativeTest-2082876409 None] Terminate volume connection completed successfully. Nov 05 17:43:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6b2e365c-169d-4d50-9b30-330646bd3085 req-eef5b87d-5108-4eb3-94f5-1d15b8bfd889 tempest-AttachVolumeNegativeTest-2082876409 None] Deleting attachment d423bfa4-0906-46b3-a2b3-c7a9dafd442d. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:43:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-506fe5df-ed05-4a41-b5d4-4e5254d81baa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "cinder-quobyte-506fe5df-ed05-4a41-b5d4-4e5254d81baa" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-quobyte-506fe5df-ed05-4a41-b5d4-4e5254d81baa" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc267120-51f6-4776-9960-df3ba2442753]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:43 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa Nov 05 17:43:43 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:43 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa" returned: 0 in 0.656s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:43 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa Nov 05 17:43:43 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:44 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-506fe5df-ed05-4a41-b5d4-4e5254d81baa" returned: 0 in 0.646s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-quobyte-506fe5df-ed05-4a41-b5d4-4e5254d81baa" released by "delete_volume" :: held 1.386s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:44 devstack cinder-volume[87126]: WARNING cinder.quota [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-164972365-949842527 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-164972365-949842527, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:43:44 devstack cinder-volume[87126]: WARNING cinder.quota [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-164972365-949842527 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-164972365-949842527, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Created reservations ['35ed9c74-e21a-4665-8fed-1672c1be97a1', '5355afa7-a446-4b42-92a7-66d74fa28e2a', 'b8b91b1f-7c77-4d22-8a2a-39ced74b5e31', '922762f6-f044-4b43-b33f-3e97a03a505a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:44 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:44 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:45 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.783s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:45 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Deleted volume successfully. Nov 05 17:43:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64b62c02-4fbd-41ce-9514-1ed755a7e626 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-506fe5df-ed05-4a41-b5d4-4e5254d81baa-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-62ff0af1-1639-4efa-845c-30a946c8adfc req-08d0d0e6-3f38-41c3-87bd-c9a0573b4d3e tempest-TestInstancesWithCinderVolumes-752452603 None] Terminate volume connection completed successfully. Nov 05 17:43:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-62ff0af1-1639-4efa-845c-30a946c8adfc req-08d0d0e6-3f38-41c3-87bd-c9a0573b4d3e tempest-TestInstancesWithCinderVolumes-752452603 None] Deleting attachment cb97e7ae-df69-4b29-a8aa-36ee49829151. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "cinder-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "cinder-quobyte-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-quobyte-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc8c104-b203-43ce-901c-257c2c8781c6]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "cinder-9f5fddb0-1a97-4f78-96e2-ecb25edea234-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-9f5fddb0-1a97-4f78-96e2-ecb25edea234-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:49 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 Nov 05 17:43:49 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "cinder-quobyte-9f5fddb0-1a97-4f78-96e2-ecb25edea234" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-quobyte-9f5fddb0-1a97-4f78-96e2-ecb25edea234" acquired by "delete_volume" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf2d0d3-d3c5-4021-95a9-fc1ccd040ed9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:50 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 Nov 05 17:43:50 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:50 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047" returned: 0 in 0.756s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:50 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047 Nov 05 17:43:50 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:50 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234" returned: 0 in 0.566s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:50 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234 Nov 05 17:43:50 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:50 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-quobyte-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047" released by "delete_volume" :: held 1.223s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:51 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Created reservations ['6cf8107e-eb72-4796-a5bc-c7ef06086d34', 'a20f3a32-01e0-46bf-8e2a-4f92c854b413', '94271a19-48e3-409a-953c-dc66fa700b41', '2c101f39-9d80-4357-b45a-fb69124cbb04'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9f5fddb0-1a97-4f78-96e2-ecb25edea234" returned: 0 in 0.433s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-quobyte-9f5fddb0-1a97-4f78-96e2-ecb25edea234" released by "delete_volume" :: held 1.101s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:51 devstack cinder-volume[87126]: WARNING cinder.quota [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-592185365-183600275 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-592185365-183600275, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:43:51 devstack cinder-volume[87126]: WARNING cinder.quota [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-592185365-183600275 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-592185365-183600275, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Created reservations ['b15f04bf-e73d-4324-9191-2ed12fe63d7e', 'ed9e37f5-013c-4393-ae74-18ba2f73426e', '9c49dab8-5062-4e66-9188-7e3f0ed4e24d', '261c9104-9bde-4566-a483-138b3e4b30f6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:43:51 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:51 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:51 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:51 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:51 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.575s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:51 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Deleted volume successfully. Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Deleted volume successfully. Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-57f2cd47-ef04-409d-aae6-c03c00148025 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-9b4e1d4d-ca85-4f61-b1bc-704f0ac57047-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67a670b4-b062-4f1f-9fb8-52ba6688415f tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-9f5fddb0-1a97-4f78-96e2-ecb25edea234-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "cinder-7cdca264-4d94-4127-9016-457702813a8f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-7cdca264-4d94-4127-9016-457702813a8f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=58,cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "cinder-quobyte-7cdca264-4d94-4127-9016-457702813a8f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-quobyte-7cdca264-4d94-4127-9016-457702813a8f" acquired by "delete_volume" :: waited 0.051s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa3bcb-9f06-4463-835d-556c82579bf7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:52 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f Nov 05 17:43:52 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Flow 'volume_create_manager' (8fe2d075-8c3b-4143-844e-d976ed7cf99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438e6ef-63f6-42ec-9c6f-04663796504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438e6ef-63f6-42ec-9c6f-04663796504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-664364713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc3364c-dbba-4106-beb1-2d3fea035e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd72bb3001214683afda845669e47712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:43:53Z,use_quota=True,user_id='5966a120f9024672bb317b29bff020a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282295f9-329d-4d37-a080-9605c0839c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282295f9-329d-4d37-a080-9605c0839c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a93a2b7-5f57-44fd-b367-519e63ec7bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:43:52 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f" returned: 0 in 0.506s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:53 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f Nov 05 17:43:53 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a93a2b7-5f57-44fd-b367-519e63ec7bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdc3364c-dbba-4106-beb1-2d3fea035e2d', 'volume_name': 'volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3dfc5f-ddb3-473c-8987-107aa8374f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3dfc5f-ddb3-473c-8987-107aa8374f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f12a02-0f90-493a-ac52-b2c8e87b9ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:43:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Volume cdc3364c-dbba-4106-beb1-2d3fea035e2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Trying to clone cdc3364c-dbba-4106-beb1-2d3fea035e2d from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:43:53 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7cdca264-4d94-4127-9016-457702813a8f" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-quobyte-7cdca264-4d94-4127-9016-457702813a8f" released by "delete_volume" :: held 0.900s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Created reservations ['8e16a424-0871-4688-ab7e-dbc4e4070e45', '6c56523f-1ad3-4071-870c-cf164ca82828', '94acc166-90ee-4824-b7bf-ee5df4b4d960', 'a6f9df5f-45ba-4220-ad7d-5af46b61744f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:43:53 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Image download 20.69 MB at 20.69 MB/s Nov 05 17:43:53 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:53 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c808848d-1234-49c9-b808-182481541006]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:54 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD Nov 05 17:43:54 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:54 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.518s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Deleted volume successfully. Nov 05 17:43:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a6d40c83-9767-44c3-8698-71570b0e43e8 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-7cdca264-4d94-4127-9016-457702813a8f-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:54 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:54 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a is fetched for user 5966a120f9024672bb317b29bff020a8. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:43:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8160aba8-a2b4-4f45-87a7-9e149cd62669]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:55 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD Nov 05 17:43:55 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "cinder-11ed8036-742d-4bdf-b3da-d294ce29743a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-11ed8036-742d-4bdf-b3da-d294ce29743a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "cinder-quobyte-11ed8036-742d-4bdf-b3da-d294ce29743a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-quobyte-11ed8036-742d-4bdf-b3da-d294ce29743a" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea55126-e898-4465-b6d3-399deb6c68e8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:55 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-664364713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc3364c-dbba-4106-beb1-2d3fea035e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd72bb3001214683afda845669e47712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:43:53Z,use_quota=True,user_id='5966a120f9024672bb317b29bff020a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Creating volume cdc3364c-dbba-4106-beb1-2d3fea035e2d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:43:55 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:43:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:55 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a Nov 05 17:43:55 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:55 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 1073741824 Nov 05 17:43:55 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-792ffbcf-6dca-40c9-91cb-403c79ebf668 req-b6a08c49-988a-4fb4-9c4e-ca2edf9c0167 tempest-TestInstancesWithCinderVolumes-752452603 None] Terminate volume connection completed successfully. Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-792ffbcf-6dca-40c9-91cb-403c79ebf668 req-b6a08c49-988a-4fb4-9c4e-ca2edf9c0167 tempest-TestInstancesWithCinderVolumes-752452603 None] Deleting attachment cbd09835-6959-4b71-b1f1-87d35eacbb84. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:43:56 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a" returned: 0 in 0.955s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:56 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a Nov 05 17:43:56 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:56 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 1073741824" returned: 0 in 0.991s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:56 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d Nov 05 17:43:56 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:56 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-11ed8036-742d-4bdf-b3da-d294ce29743a" returned: 0 in 0.419s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-quobyte-11ed8036-742d-4bdf-b3da-d294ce29743a" released by "delete_volume" :: held 1.466s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Created reservations ['22c6491a-d1ff-407a-9f01-4207bfadd7b9', '4ac8057f-c9ae-4629-a924-273825b9edca', '99070bc9-8505-4b60-8ce4-e06ff6b05c16', 'e2b9da8f-5fb9-4698-add9-ba381574c8a5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:57 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:57 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:57 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d" returned: 0 in 0.447s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Attempting download of 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume cdc3364c-dbba-4106-beb1-2d3fea035e2d. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fd54f2-0320-4f19-a9e8-8dae09a54545]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_oym869nb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "cinder-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:57 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Deleted volume successfully. Nov 05 17:43:57 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_oym869nb Nov 05 17:43:57 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fd3916c4-fd73-4d1e-aab6-ca2bf1a66d10 tempest-AttachVolumeNegativeTest-2082876409 None] Lock "cinder-11ed8036-742d-4bdf-b3da-d294ce29743a-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "cinder-quobyte-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-quobyte-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[191227fd-714b-4a14-894c-ad6ee16bbcbf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:57 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 Nov 05 17:43:57 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:57 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_oym869nb" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_oym869nb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:57 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_oym869nb Nov 05 17:43:57 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:57 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21" returned: 0 in 0.456s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:58 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21 Nov 05 17:43:58 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:58 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_oym869nb" returned: 1 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_oym869nb' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be97a9d-6258-48db-b7b1-6ae197ba8186]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:58 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD Nov 05 17:43:58 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:58 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-quobyte-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21" released by "delete_volume" :: held 0.805s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:43:58 devstack cinder-volume[87126]: WARNING cinder.quota [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1161197167-465769237 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1161197167-465769237, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:43:58 devstack cinder-volume[87126]: WARNING cinder.quota [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1161197167-465769237 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1161197167-465769237, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Created reservations ['27c30ed6-47da-495b-b277-e18ca5e0eebc', '24ed4404-535a-4b71-a732-a40fb9e83c5e', '99f899e3-5843-4471-9411-cdc024f77420', '41aff8f8-7119-4829-81b4-61bd63c375c7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:58 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:43:58 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:58 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] 801ade9d-3bc5-40a6-b715-627da3a7cb0a was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:43:58 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d Nov 05 17:43:58 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:43:58 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:43:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Deleted volume successfully. Nov 05 17:43:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09eb088c-3300-4236-ae55-81910d0f9a26 tempest-TestInstancesWithCinderVolumes-752452603 None] Lock "cinder-a981baf8-41cb-4cc8-8fc0-1a8e89ae4d21-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:00 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d" returned: 0 in 2.189s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:00 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_cwllvfmkdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:44:00 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Converted 112.00 MB image at 51.10 MB/s Nov 05 17:44:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:00 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 1G Nov 05 17:44:00 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:01 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 1G" returned: 0 in 0.332s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Downloaded image 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume cdc3364c-dbba-4106-beb1-2d3fea035e2d successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a for user 5966a120f9024672bb317b29bff020a8 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Marking volume cdc3364c-dbba-4106-beb1-2d3fea035e2d as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Copying metadata from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a to cdc3364c-dbba-4106-beb1-2d3fea035e2d. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Creating volume glance metadata for volume cdc3364c-dbba-4106-beb1-2d3fea035e2d backed by image 801ade9d-3bc5-40a6-b715-627da3a7cb0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f12a02-0f90-493a-ac52-b2c8e87b9ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a77c74-bdb7-4a07-bb32-c9155f0e5876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Volume volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d (cdc3364c-dbba-4106-beb1-2d3fea035e2d): created successfully Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a77c74-bdb7-4a07-bb32-c9155f0e5876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Flow 'volume_create_manager' (8fe2d075-8c3b-4143-844e-d976ed7cf99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-87c822a6-c856-4069-9b91-2c8f241e691c tempest-VolumesExtendTest-142346587 None] Created volume successfully. Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a08981-0ab5-4a6c-932b-7963ce8ca053]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:01 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d Nov 05 17:44:01 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:02 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d" returned: 0 in 0.531s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 2G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d 2G" returned: 0 in 0.134s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.703s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f5499f5f-dfeb-44c8-8592-d76db44aa2fb tempest-VolumesExtendTest-142346587 None] Extend volume completed successfully. Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Acquiring lock "cinder-cdc3364c-dbba-4106-beb1-2d3fea035e2d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Lock "cinder-cdc3364c-dbba-4106-beb1-2d3fea035e2d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Acquiring lock "cinder-quobyte-cdc3364c-dbba-4106-beb1-2d3fea035e2d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-cdc3364c-dbba-4106-beb1-2d3fea035e2d" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0bc9a9-46c1-4104-8a7b-d1731ef56d51]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:03 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d Nov 05 17:44:03 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:03 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d" returned: 0 in 0.537s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:03 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d Nov 05 17:44:03 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:04 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cdc3364c-dbba-4106-beb1-2d3fea035e2d" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-cdc3364c-dbba-4106-beb1-2d3fea035e2d" released by "delete_volume" :: held 0.928s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Created reservations ['accfd554-ddd0-4cae-b8a5-77313507aa4e', '9172fa79-4e33-48f4-a52f-cea9f49fcc8e', 'c5a9de69-57ae-497e-b30a-c3fd841b8c1b', '3d878305-6469-4d0d-a3fa-96791845de30'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:04 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:04 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:04 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.316s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Deleted volume successfully. Nov 05 17:44:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-529ad502-04ac-49fa-af91-a1ddf0f3d561 tempest-VolumesExtendTest-142346587 None] Lock "cinder-cdc3364c-dbba-4106-beb1-2d3fea035e2d-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Flow 'volume_create_manager' (a57b014f-3202-45d4-8325-f3d8a05d02fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1f7237-f744-454b-a612-0870abd2ad87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1f7237-f744-454b-a612-0870abd2ad87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1794877345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcf71d2-87fc-4ab0-8b34-9918022b3d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd72bb3001214683afda845669e47712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:06Z,use_quota=True,user_id='5966a120f9024672bb317b29bff020a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621a7914-674c-4d61-aa88-578fa15073ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621a7914-674c-4d61-aa88-578fa15073ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59727e3b-c37b-41cd-9777-8db461709463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59727e3b-c37b-41cd-9777-8db461709463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcf71d2-87fc-4ab0-8b34-9918022b3d86', 'volume_name': 'volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d303cf-a465-4e5b-ac55-1c84d7943726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d303cf-a465-4e5b-ac55-1c84d7943726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c091fc9b-012e-45fc-ac0f-bcc9e9ef15b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Volume 2bcf71d2-87fc-4ab0-8b34-9918022b3d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86', 'volume_size': 1} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1794877345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcf71d2-87fc-4ab0-8b34-9918022b3d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd72bb3001214683afda845669e47712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:06Z,use_quota=True,user_id='5966a120f9024672bb317b29bff020a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Creating volume 2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:06 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 1073741824 Nov 05 17:44:06 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:06 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 1073741824" returned: 0 in 0.515s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:06 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 Nov 05 17:44:06 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:07 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" returned: 0 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c091fc9b-012e-45fc-ac0f-bcc9e9ef15b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878ba216-0b46-4b31-ad4c-1b7bff41f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Flow 'volume_create_manager' (d6ed7728-e87f-42cd-8b93-eeff8998fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ab40c2-db62-4c24-9d44-592663225f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Volume volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 (2bcf71d2-87fc-4ab0-8b34-9918022b3d86): created successfully Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878ba216-0b46-4b31-ad4c-1b7bff41f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Flow 'volume_create_manager' (a57b014f-3202-45d4-8325-f3d8a05d02fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ab40c2-db62-4c24-9d44-592663225f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-994161026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d03658-5d95-4d71-b5da-7f3e3585f35c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ced97ff59524dd4b5f7ecad785f3a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:07Z,use_quota=True,user_id='5a2943cdbd7d4f5485d338e0bd9fb8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb03361-c043-4d29-854b-c233c37c9fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb03361-c043-4d29-854b-c233c37c9fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98944b6b-0333-46fc-a727-d2dc5794c53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98944b6b-0333-46fc-a727-d2dc5794c53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d03658-5d95-4d71-b5da-7f3e3585f35c', 'volume_name': 'volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3825a844-0af3-47a9-bf42-9e9771d6891c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3825a844-0af3-47a9-bf42-9e9771d6891c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048dd441-1008-4e78-955f-7c6ca429931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Volume c1d03658-5d95-4d71-b5da-7f3e3585f35c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c', 'volume_size': 1} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-994161026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d03658-5d95-4d71-b5da-7f3e3585f35c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ced97ff59524dd4b5f7ecad785f3a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:07Z,use_quota=True,user_id='5a2943cdbd7d4f5485d338e0bd9fb8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Creating volume c1d03658-5d95-4d71-b5da-7f3e3585f35c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:07 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5d26235b-f696-4da6-80ae-e8f6dca2c29b tempest-VolumesExtendTest-142346587 None] Created volume successfully. Nov 05 17:44:07 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c 1073741824 Nov 05 17:44:07 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:07 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7db557ef-a77f-4844-8bf9-29171d32cb20 req-b0d619e0-ab3c-4cc6-93b7-e71359064ece tempest-AttachVolumeTestJSON-1966362438 None] Terminate volume connection completed successfully. Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-7db557ef-a77f-4844-8bf9-29171d32cb20 req-b0d619e0-ab3c-4cc6-93b7-e71359064ece tempest-AttachVolumeTestJSON-1966362438 None] Deleting attachment 2e7414fa-5ef3-41a0-825a-a2a3a55623c5. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c 1073741824" returned: 0 in 0.557s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:07 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c Nov 05 17:44:07 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:08 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048dd441-1008-4e78-955f-7c6ca429931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4572ce7b-5456-433b-8595-2f823d7dcb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Volume volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c (c1d03658-5d95-4d71-b5da-7f3e3585f35c): created successfully Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4572ce7b-5456-433b-8595-2f823d7dcb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Flow 'volume_create_manager' (d6ed7728-e87f-42cd-8b93-eeff8998fec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-8ce0fa26-38e8-4c84-87b3-f01d080f552b req-db489221-f7ad-43fa-b804-e79fad06731c tempest-VolumesGetTestJSON-2055701020 None] Created volume successfully. Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Creating offline snapshot bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 of volume 2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0257d88f-c981-4bf9-be7a-5508c0950e40]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:08 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 Nov 05 17:44:08 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:08 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" returned: 0 in 0.405s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:08 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 1G Nov 05 17:44:08 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:09 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 1G" returned: 0 in 0.510s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:09 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 Nov 05 17:44:09 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Acquiring lock "cinder-c1d03658-5d95-4d71-b5da-7f3e3585f35c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Lock "cinder-c1d03658-5d95-4d71-b5da-7f3e3585f35c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Acquiring lock "cinder-quobyte-c1d03658-5d95-4d71-b5da-7f3e3585f35c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Lock "cinder-quobyte-c1d03658-5d95-4d71-b5da-7f3e3585f35c" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea625e8-773f-4fac-a030-b5392f8432ba]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:09 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:09 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 is being set with open permissions: ugo+rw Nov 05 17:44:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:09 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c Nov 05 17:44:09 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:09 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 Nov 05 17:44:09 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:10 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c" returned: 0 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:10 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c Nov 05 17:44:10 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:10 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:10 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.info Nov 05 17:44:10 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:10 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c1d03658-5d95-4d71-b5da-7f3e3585f35c" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Lock "cinder-quobyte-c1d03658-5d95-4d71-b5da-7f3e3585f35c" released by "delete_volume" :: held 0.847s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG cinder.quota [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Created reservations ['e71afc71-8f46-4d42-b16b-0792d0446eb5', 'fab3a174-5e1d-43aa-a302-9fa85ae4636d', '13dc5d5c-c894-4d85-ae6d-2aa145ac2081', 'e9bf30ce-3dc5-40ad-99c4-ddeb6c807f8d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:10 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.info" returned: 0 in 0.495s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:10 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.info is being set with open permissions: ugo+rw Nov 05 17:44:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:10 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:10 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:10 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.info Nov 05 17:44:10 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:11 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG cinder.manager [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Deleted volume successfully. Nov 05 17:44:11 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.info" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-965d82e3-e117-4517-b93e-7aa55a9ad2b6 req-77c68b7a-e741-4fc2-9c2e-c60d87a5d8e8 tempest-VolumesGetTestJSON-2055701020 None] Lock "cinder-c1d03658-5d95-4d71-b5da-7f3e3585f35c-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-29981b46-a7c0-4dd0-bfba-28b4483650c0 tempest-VolumesExtendTest-142346587 None] Create snapshot completed successfully Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52df5d6-9506-4104-9fce-d396838d030e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:12 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 Nov 05 17:44:12 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:12 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" returned: 0 in 0.674s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 2G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 2G" returned: 0 in 0.215s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.965s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3b13b863-5320-4dac-8818-cbc66245b20c tempest-VolumesExtendTest-142346587 None] Extend volume completed successfully. Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Acquiring lock "cinder-bac8de1a-2c46-4eea-8ac2-eaa8d5424f25-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Lock "cinder-bac8de1a-2c46-4eea-8ac2-eaa8d5424f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Acquiring lock "cinder-quobyte-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Acquiring lock "cinder-quobyte-bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Deleting offline snapshot bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 of volume 2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] snapshot_file for this snap is: volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f7b32-76db-4744-a350-52664d0ed69d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:13 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 Nov 05 17:44:13 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:13 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:13 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:14 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.578s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:44:14 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" returned: 0 in 0.854s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[417186d2-789b-4d3f-b507-4a4074bb268a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:14 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 Nov 05 17:44:14 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:15 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" returned: 0 in 0.890s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:15 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 Nov 05 17:44:15 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:15 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" returned: 0 in 0.558s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:16 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25 Nov 05 17:44:16 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:16 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86.bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" returned: 0 in 0.538s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-bac8de1a-2c46-4eea-8ac2-eaa8d5424f25" released by "_delete_snapshot" :: held 3.069s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" released by "delete_snapshot" :: held 3.109s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:16 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=102,cinder:SELECT=102,cinder:DELETE=8,cinder:INSERT=25 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:44:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Created reservations ['c10203e5-c39b-4e0d-9707-9f09f432cdc5', '868e9253-cb98-4be4-9064-4124fcc8fc38', '9ec1bf96-c393-4f45-9e2a-f8c2bd898711', 'a06d2bf2-0ee4-43d1-a11c-c8134265b25d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Delete snapshot completed successfully. Nov 05 17:44:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-112ab9a5-7b54-434e-b524-a859fadf4503 tempest-VolumesExtendTest-142346587 None] Lock "cinder-bac8de1a-2c46-4eea-8ac2-eaa8d5424f25-delete_snapshot" released by "delete_snapshot" :: held 3.383s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Acquiring lock "cinder-2bcf71d2-87fc-4ab0-8b34-9918022b3d86-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Lock "cinder-2bcf71d2-87fc-4ab0-8b34-9918022b3d86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Acquiring lock "cinder-quobyte-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43624d0-8f7c-4855-bf9f-267c117ccffc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:18 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 Nov 05 17:44:18 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:18 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" returned: 0 in 0.447s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:18 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86 Nov 05 17:44:18 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6b631d9-6965-407a-af9f-935a9d0faf58 tempest-BackendsCapabilitiesAdminTestsJSON-822743175 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552764892578, 'free_capacity_gb': 1773.4552764892578, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac032990-5d71-41d8-a08f-f78a931fc7c5 tempest-BackendsCapabilitiesAdminTestsJSON-822743175 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552764892578, 'free_capacity_gb': 1773.4552764892578, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 17:44:18 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Lock "cinder-quobyte-2bcf71d2-87fc-4ab0-8b34-9918022b3d86" released by "delete_volume" :: held 0.868s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:18 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Created reservations ['fedb8e04-0fe7-4529-940c-d22ee3562378', '98ca752d-de39-4c6d-aa2c-41be43bf0ad8', '2d4a3168-a93d-463f-890f-69463650b9d1', '8db2d3d3-f0dc-4554-87bb-2dd250d6146e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:19 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:19 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:19 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Deleted volume successfully. Nov 05 17:44:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc5ca1f1-dee6-447c-962b-0b5c785dd469 tempest-VolumesExtendTest-142346587 None] Lock "cinder-2bcf71d2-87fc-4ab0-8b34-9918022b3d86-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Flow 'volume_create_manager' (e6287446-41cc-4414-99b7-5dd0ffa4eca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d817695-d002-4990-88c3-80928336a268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d817695-d002-4990-88c3-80928336a268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1005147645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478b031c-499f-477f-ad1f-9d44c7d4546c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e5b64e3ecb1409c9d6bacff610e240d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:26Z,use_quota=True,user_id='33f34fc84cfa436794beb4203a74aa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623ee955-7c24-4f9d-bb8b-74aa020d44f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623ee955-7c24-4f9d-bb8b-74aa020d44f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865eb664-77ee-4731-84b5-f73ef0afc0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865eb664-77ee-4731-84b5-f73ef0afc0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478b031c-499f-477f-ad1f-9d44c7d4546c', 'volume_name': 'volume-478b031c-499f-477f-ad1f-9d44c7d4546c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17bc7d6-dac1-455b-9486-d142def47291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17bc7d6-dac1-455b-9486-d142def47291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b06cf6-7a81-40ea-921d-381af2ae7cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Volume 478b031c-499f-477f-ad1f-9d44c7d4546c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478b031c-499f-477f-ad1f-9d44c7d4546c', 'volume_size': 1} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1005147645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478b031c-499f-477f-ad1f-9d44c7d4546c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e5b64e3ecb1409c9d6bacff610e240d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:26Z,use_quota=True,user_id='33f34fc84cfa436794beb4203a74aa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Creating volume 478b031c-499f-477f-ad1f-9d44c7d4546c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:26 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:26 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c 1073741824 Nov 05 17:44:26 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:26 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c 1073741824" returned: 0 in 0.661s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:26 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c Nov 05 17:44:26 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:27 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b06cf6-7a81-40ea-921d-381af2ae7cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478b031c-499f-477f-ad1f-9d44c7d4546c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df6a04d-b372-42ea-9d24-19b9cc6ea7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Volume volume-478b031c-499f-477f-ad1f-9d44c7d4546c (478b031c-499f-477f-ad1f-9d44c7d4546c): created successfully Nov 05 17:44:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df6a04d-b372-42ea-9d24-19b9cc6ea7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Flow 'volume_create_manager' (e6287446-41cc-4414-99b7-5dd0ffa4eca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2b8bcff4-2420-4a06-a9f3-4278b65f32a9 tempest-VolumesListTestJSON-1947554196 None] Created volume successfully. Nov 05 17:44:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3db506b5-9736-4db9-b32e-906a22ac08ed tempest-GroupsTest-1342047154 None] Group tempest-Group1-1281879250: creating Nov 05 17:44:28 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Flow 'volume_create_manager' (f34ae283-a44f-47bd-be1f-741362904cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863a06c9-56ba-4ce1-9b66-69392651ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3db506b5-9736-4db9-b32e-906a22ac08ed tempest-GroupsTest-1342047154 None] Group tempest-Group1-1281879250: created successfully Nov 05 17:44:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863a06c9-56ba-4ce1-9b66-69392651ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-239832977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023d3878-43a5-47d5-ad08-969f3a5c2ff8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e5b64e3ecb1409c9d6bacff610e240d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:29Z,use_quota=True,user_id='33f34fc84cfa436794beb4203a74aa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc050c0-931f-46bc-8ae2-ed7d7ed91276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc050c0-931f-46bc-8ae2-ed7d7ed91276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a21b69-b70e-438a-b1fa-ff0ceecd4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a21b69-b70e-438a-b1fa-ff0ceecd4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023d3878-43a5-47d5-ad08-969f3a5c2ff8', 'volume_name': 'volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e9471-20bf-4783-b1c1-40e874240d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e9471-20bf-4783-b1c1-40e874240d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8417a1-ddb6-42a0-894f-7c3e2a305c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Volume 023d3878-43a5-47d5-ad08-969f3a5c2ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8', 'volume_size': 1} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-239832977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023d3878-43a5-47d5-ad08-969f3a5c2ff8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e5b64e3ecb1409c9d6bacff610e240d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:29Z,use_quota=True,user_id='33f34fc84cfa436794beb4203a74aa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Creating volume 023d3878-43a5-47d5-ad08-969f3a5c2ff8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:29 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3db506b5-9736-4db9-b32e-906a22ac08ed tempest-GroupsTest-1342047154 None] Create group completed successfully. Nov 05 17:44:29 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 1073741824 Nov 05 17:44:29 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:29 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 1073741824" returned: 0 in 0.557s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:29 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 Nov 05 17:44:29 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:29 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8" returned: 0 in 0.295s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8417a1-ddb6-42a0-894f-7c3e2a305c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a6845d-7712-4a0d-8da3-bac771fbbf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Volume volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 (023d3878-43a5-47d5-ad08-969f3a5c2ff8): created successfully Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a6845d-7712-4a0d-8da3-bac771fbbf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Flow 'volume_create_manager' (f34ae283-a44f-47bd-be1f-741362904cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c7d983c4-bce1-45bd-aa3a-45ecbd6cf0b6 tempest-VolumesListTestJSON-1947554196 None] Created volume successfully. Nov 05 17:44:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-723dca0b-8cee-44b6-9433-c0c0307f0fb9 tempest-GroupsTest-1342047154 None] Group tempest-Group2-1759683601: creating Nov 05 17:44:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-723dca0b-8cee-44b6-9433-c0c0307f0fb9 tempest-GroupsTest-1342047154 None] Group tempest-Group2-1759683601: created successfully Nov 05 17:44:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-723dca0b-8cee-44b6-9433-c0c0307f0fb9 tempest-GroupsTest-1342047154 None] Create group completed successfully. Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Flow 'volume_create_manager' (4103757d-8fcb-4236-abb7-e07da8aefaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8fa0c4-0f2c-420c-aeac-ea174252a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8fa0c4-0f2c-420c-aeac-ea174252a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-463602052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266fb1e2-198e-4db3-8d5c-5fcf580b4e1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e5b64e3ecb1409c9d6bacff610e240d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:32Z,use_quota=True,user_id='33f34fc84cfa436794beb4203a74aa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c1124-ee31-444b-b6b6-f376af2a8255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c1124-ee31-444b-b6b6-f376af2a8255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02072474-5c6d-42ba-8f00-73711c005751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02072474-5c6d-42ba-8f00-73711c005751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266fb1e2-198e-4db3-8d5c-5fcf580b4e1d', 'volume_name': 'volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4a2ed1-3693-4b1b-85f3-23155849a9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4a2ed1-3693-4b1b-85f3-23155849a9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d7dca6-6270-4cff-b921-3f0a067f6172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Volume 266fb1e2-198e-4db3-8d5c-5fcf580b4e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d', 'volume_size': 1} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-463602052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266fb1e2-198e-4db3-8d5c-5fcf580b4e1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e5b64e3ecb1409c9d6bacff610e240d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:32Z,use_quota=True,user_id='33f34fc84cfa436794beb4203a74aa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Creating volume 266fb1e2-198e-4db3-8d5c-5fcf580b4e1d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:31 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:31 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d 1073741824 Nov 05 17:44:31 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Flow 'volume_create_manager' (91a7fea8-c5cb-4376-bb0b-7afc479f96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d6ef76-7132-4df2-a6a5-7eae89e04434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d6ef76-7132-4df2-a6a5-7eae89e04434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1038801165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13826e6e-ae04-4897-b10e-07c9df2efa0b,host='devstack@QuobyteHD#QuobyteHD',id=f5c52b52-3118-4f28-b1a8-382c7e462355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2785c9e88f487f8740c4bc9d3714fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:32Z,use_quota=True,user_id='a55478dd7deb4d84977f1602f56c9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61150771-bb70-4b44-a328-48f210562d74),volume_type_id=61150771-bb70-4b44-a328-48f210562d74)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acadee9-1249-46e9-9719-be7ef3d37d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acadee9-1249-46e9-9719-be7ef3d37d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431fc229-ad6f-4ac2-ae00-a0e22349a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431fc229-ad6f-4ac2-ae00-a0e22349a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c52b52-3118-4f28-b1a8-382c7e462355', 'volume_name': 'volume-f5c52b52-3118-4f28-b1a8-382c7e462355', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb17e9b5-1b67-48a1-b872-7b75f1308886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb17e9b5-1b67-48a1-b872-7b75f1308886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922ebf54-2161-4848-a7c9-52d70ed7a5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Volume f5c52b52-3118-4f28-b1a8-382c7e462355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c52b52-3118-4f28-b1a8-382c7e462355', 'volume_size': 1} Nov 05 17:44:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:32 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d 1073741824" returned: 0 in 0.486s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:32 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d Nov 05 17:44:32 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:32 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13826e6e-ae04-4897-b10e-07c9df2efa0b,created_at=2026-11-05T16:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1038801165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13826e6e-ae04-4897-b10e-07c9df2efa0b,host='devstack@QuobyteHD#QuobyteHD',id=f5c52b52-3118-4f28-b1a8-382c7e462355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2785c9e88f487f8740c4bc9d3714fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:32Z,use_quota=True,user_id='a55478dd7deb4d84977f1602f56c9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61150771-bb70-4b44-a328-48f210562d74),volume_type_id=61150771-bb70-4b44-a328-48f210562d74)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Creating volume f5c52b52-3118-4f28-b1a8-382c7e462355 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:32 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:32 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 1073741824 Nov 05 17:44:32 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d7dca6-6270-4cff-b921-3f0a067f6172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4644e2-2750-4985-a978-124acc1fde6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Volume volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d (266fb1e2-198e-4db3-8d5c-5fcf580b4e1d): created successfully Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4644e2-2750-4985-a978-124acc1fde6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Flow 'volume_create_manager' (4103757d-8fcb-4236-abb7-e07da8aefaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a000275c-b9a2-4deb-a239-43b9b20c8868 tempest-VolumesListTestJSON-1947554196 None] Created volume successfully. Nov 05 17:44:33 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 1073741824" returned: 0 in 0.521s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:33 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 Nov 05 17:44:33 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:33 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922ebf54-2161-4848-a7c9-52d70ed7a5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c52b52-3118-4f28-b1a8-382c7e462355', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124cdcfe-e671-4a12-8de0-4a10f6757436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Volume volume-f5c52b52-3118-4f28-b1a8-382c7e462355 (f5c52b52-3118-4f28-b1a8-382c7e462355): created successfully Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124cdcfe-e671-4a12-8de0-4a10f6757436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Flow 'volume_create_manager' (91a7fea8-c5cb-4376-bb0b-7afc479f96ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a703b429-2485-4fb0-a1e5-0d5d86053ca3 tempest-GroupsTest-1342047154 None] Created volume successfully. Nov 05 17:44:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Acquiring lock "cinder-quobyte-f5c52b52-3118-4f28-b1a8-382c7e462355" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Lock "cinder-quobyte-f5c52b52-3118-4f28-b1a8-382c7e462355" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a64b5-e5b3-4884-98de-a326e4de9b28]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:36 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 Nov 05 17:44:36 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:36 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355" returned: 0 in 0.515s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:36 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355 Nov 05 17:44:36 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "cinder-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:36 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f5c52b52-3118-4f28-b1a8-382c7e462355" returned: 0 in 0.453s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Lock "cinder-quobyte-f5c52b52-3118-4f28-b1a8-382c7e462355" released by "delete_volume" :: held 1.065s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "cinder-quobyte-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-quobyte-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ef368-b920-456b-b9ec-09c29474fb8a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Created reservations ['2290a214-18fe-48cb-bb8e-684ad3d095b7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:37 devstack cinder-volume[87126]: WARNING cinder.quota [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1548382477 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1548382477, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:44:37 devstack cinder-volume[87126]: WARNING cinder.quota [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1548382477 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1548382477, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Created reservations ['1bdfbcdd-e0b5-4b3f-9203-2cd86b68eef1', 'cd13c83e-77e2-4fb0-85c6-15b295f3164b', 'fac0f59a-cd8e-4186-904f-a7764fdd8bcb', '237e17f3-28dd-4ba6-b79e-2224356a5759'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:37 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d Nov 05 17:44:37 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:37 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:37 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:37 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d" returned: 0 in 0.657s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:37 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d Nov 05 17:44:37 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:37 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:37 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a9495b83-392f-41ee-ac97-6a4ce7c5d13a tempest-GroupsTest-1342047154 None] Delete group completed successfully. Nov 05 17:44:38 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-quobyte-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d" released by "delete_volume" :: held 1.066s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Created reservations ['83a7fa9b-9aa1-45ec-82b0-2085fb1d5054', '67f23a3b-a881-49ca-94b4-e80301e17012', 'fd4ac025-1c8e-4054-81e3-a10e69c713e5', '9e8135c0-daee-4844-8d63-7a0f8ff97391'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:38 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:38 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:38 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Deleted volume successfully. Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-89a76468-a092-4696-b0bb-0a4f67074712 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-266fb1e2-198e-4db3-8d5c-5fcf580b4e1d-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Created reservations ['7047fe8b-b9e4-499e-8046-c2f705ecfd77'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:38 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:38 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:39 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-532ae706-4ef9-4b64-9fdf-6a1e672aa280 tempest-GroupsTest-1342047154 None] Delete group completed successfully. Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "cinder-023d3878-43a5-47d5-ad08-969f3a5c2ff8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-023d3878-43a5-47d5-ad08-969f3a5c2ff8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "cinder-quobyte-023d3878-43a5-47d5-ad08-969f3a5c2ff8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-quobyte-023d3878-43a5-47d5-ad08-969f3a5c2ff8" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bd3989-58f0-437c-ba6e-10618bd3e88a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:39 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 Nov 05 17:44:39 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:39 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8" returned: 0 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:39 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8 Nov 05 17:44:39 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:40 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-023d3878-43a5-47d5-ad08-969f3a5c2ff8" returned: 0 in 0.423s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-quobyte-023d3878-43a5-47d5-ad08-969f3a5c2ff8" released by "delete_volume" :: held 1.057s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Created reservations ['b69beaa8-a139-46e9-9cc1-71875d16bee6', 'dc5ec98d-a2d2-4155-9c03-2382f0864213', 'e7854a9c-a83b-41f2-b4e6-f5eed7266e4d', 'aa74a9e4-4b38-4d35-9c83-8ee5283ade6b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-72ef336a-e702-4cf3-9d71-be140ba1f649 tempest-GroupsTest-1342047154 None] Group tempest-GroupsTest-Group-2059357645: creating Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-72ef336a-e702-4cf3-9d71-be140ba1f649 tempest-GroupsTest-1342047154 None] Group tempest-GroupsTest-Group-2059357645: created successfully Nov 05 17:44:40 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:40 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-72ef336a-e702-4cf3-9d71-be140ba1f649 tempest-GroupsTest-1342047154 None] Create group completed successfully. Nov 05 17:44:40 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Deleted volume successfully. Nov 05 17:44:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-394dc60d-2e30-4d0d-ab59-1e506b297a30 tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-023d3878-43a5-47d5-ad08-969f3a5c2ff8-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "cinder-478b031c-499f-477f-ad1f-9d44c7d4546c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-478b031c-499f-477f-ad1f-9d44c7d4546c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "cinder-quobyte-478b031c-499f-477f-ad1f-9d44c7d4546c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-quobyte-478b031c-499f-477f-ad1f-9d44c7d4546c" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3794289c-0a9a-4a49-ae4d-c1f223241a68]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:41 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c Nov 05 17:44:41 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:42 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c" returned: 0 in 0.585s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:42 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c Nov 05 17:44:42 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Flow 'volume_create_manager' (7ad513c1-2998-421a-8414-40979c9694d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7bb1fd-c187-4108-afe8-5672f6a40d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7bb1fd-c187-4108-afe8-5672f6a40d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820186403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c658e99-30e0-4717-806f-aea078904053,host='devstack@QuobyteHD#QuobyteHD',id=1a777233-1d0d-4d97-8bc8-09ea688ee80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2785c9e88f487f8740c4bc9d3714fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:42Z,use_quota=True,user_id='a55478dd7deb4d84977f1602f56c9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e973229c-7211-485f-9aa3-8209d760d0b6),volume_type_id=e973229c-7211-485f-9aa3-8209d760d0b6)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40752e8-c5df-40ac-b35f-41c9c6184676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40752e8-c5df-40ac-b35f-41c9c6184676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3403c62d-a77a-4d9c-8d93-cbdc591837be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3403c62d-a77a-4d9c-8d93-cbdc591837be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a777233-1d0d-4d97-8bc8-09ea688ee80f', 'volume_name': 'volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdb9a1b-0f78-4186-a1b6-45f5a9679f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdb9a1b-0f78-4186-a1b6-45f5a9679f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edca78ad-e294-4fac-8ab7-543da88a2ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Volume 1a777233-1d0d-4d97-8bc8-09ea688ee80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f', 'volume_size': 1} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c658e99-30e0-4717-806f-aea078904053,created_at=2026-11-05T16:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820186403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c658e99-30e0-4717-806f-aea078904053,host='devstack@QuobyteHD#QuobyteHD',id=1a777233-1d0d-4d97-8bc8-09ea688ee80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2785c9e88f487f8740c4bc9d3714fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:42Z,use_quota=True,user_id='a55478dd7deb4d84977f1602f56c9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e973229c-7211-485f-9aa3-8209d760d0b6),volume_type_id=e973229c-7211-485f-9aa3-8209d760d0b6)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Creating volume 1a777233-1d0d-4d97-8bc8-09ea688ee80f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:42 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:42 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f 1073741824 Nov 05 17:44:42 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:42 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-478b031c-499f-477f-ad1f-9d44c7d4546c" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-quobyte-478b031c-499f-477f-ad1f-9d44c7d4546c" released by "delete_volume" :: held 1.054s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:42 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Created reservations ['438579c9-c0dc-4b10-8d7d-e0eed15b85b0', '39b1e565-3a5b-4d17-9482-dc3dd217a137', 'd709c5c7-a5ae-4082-9fe9-c273b4784e6c', '20557709-a463-44ef-acab-b2ea06b7faf2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:43 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:43 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:43 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f 1073741824" returned: 0 in 0.618s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:43 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Deleted volume successfully. Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-02905c86-1817-4c02-8a07-d09de7b6bb4f tempest-VolumesListTestJSON-1947554196 None] Lock "cinder-478b031c-499f-477f-ad1f-9d44c7d4546c-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:43 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f Nov 05 17:44:43 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:43 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edca78ad-e294-4fac-8ab7-543da88a2ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011b6288-6aa8-4023-90f9-795d88f841fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Volume volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f (1a777233-1d0d-4d97-8bc8-09ea688ee80f): created successfully Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011b6288-6aa8-4023-90f9-795d88f841fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Flow 'volume_create_manager' (7ad513c1-2998-421a-8414-40979c9694d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e999e0b1-70fd-498d-ae1e-71acf0171436 tempest-GroupsTest-1342047154 None] Created volume successfully. Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Flow 'volume_create_manager' (aef96ad5-b2d7-4ba3-bd8d-7b91e7bd3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba44ec3a-e708-4900-ace0-c8c0acabca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba44ec3a-e708-4900-ace0-c8c0acabca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137883649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c658e99-30e0-4717-806f-aea078904053,host='devstack@QuobyteHD#QuobyteHD',id=8341557f-0f44-4d99-b7af-c17461ffb22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2785c9e88f487f8740c4bc9d3714fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:46Z,use_quota=True,user_id='a55478dd7deb4d84977f1602f56c9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e973229c-7211-485f-9aa3-8209d760d0b6),volume_type_id=e973229c-7211-485f-9aa3-8209d760d0b6)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61714819-42af-44f5-97b9-0412c7600bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61714819-42af-44f5-97b9-0412c7600bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cc91da-46ca-4f29-a7f3-a6f539406a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cc91da-46ca-4f29-a7f3-a6f539406a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8341557f-0f44-4d99-b7af-c17461ffb22a', 'volume_name': 'volume-8341557f-0f44-4d99-b7af-c17461ffb22a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67d2be-7008-47e0-a47e-9c1133ee8796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67d2be-7008-47e0-a47e-9c1133ee8796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99d6134-27d0-4e87-b6bb-295212175742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Volume 8341557f-0f44-4d99-b7af-c17461ffb22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8341557f-0f44-4d99-b7af-c17461ffb22a', 'volume_size': 1} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c658e99-30e0-4717-806f-aea078904053,created_at=2026-11-05T16:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137883649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c658e99-30e0-4717-806f-aea078904053,host='devstack@QuobyteHD#QuobyteHD',id=8341557f-0f44-4d99-b7af-c17461ffb22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2785c9e88f487f8740c4bc9d3714fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:44:46Z,use_quota=True,user_id='a55478dd7deb4d84977f1602f56c9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e973229c-7211-485f-9aa3-8209d760d0b6),volume_type_id=e973229c-7211-485f-9aa3-8209d760d0b6)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Creating volume 8341557f-0f44-4d99-b7af-c17461ffb22a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:44:45 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:44:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:45 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a 1073741824 Nov 05 17:44:45 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:46 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a 1073741824" returned: 0 in 0.627s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:46 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a Nov 05 17:44:46 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:46 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99d6134-27d0-4e87-b6bb-295212175742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8341557f-0f44-4d99-b7af-c17461ffb22a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06ba099-a600-4493-a60f-7c77bdcf22de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:44:46 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Volume volume-8341557f-0f44-4d99-b7af-c17461ffb22a (8341557f-0f44-4d99-b7af-c17461ffb22a): created successfully Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06ba099-a600-4493-a60f-7c77bdcf22de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:44:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Flow 'volume_create_manager' (aef96ad5-b2d7-4ba3-bd8d-7b91e7bd3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:44:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6087fb6a-5efc-4bd1-849e-b7a409825065 tempest-GroupsTest-1342047154 None] Created volume successfully. Nov 05 17:44:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-91c4cc20-53dc-4950-894e-b15702929462 tempest-GroupsTest-1342047154 None] Update group completed successfully. Nov 05 17:44:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2dcc672d-7506-48f1-af6c-c42835c470f7 tempest-GroupsTest-1342047154 None] Update group completed successfully. Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Acquiring lock "cinder-quobyte-1a777233-1d0d-4d97-8bc8-09ea688ee80f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Lock "cinder-quobyte-1a777233-1d0d-4d97-8bc8-09ea688ee80f" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9fdb8-043d-4dc2-ad94-a33cb3991573]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:52 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f Nov 05 17:44:52 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:52 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f" returned: 0 in 0.463s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:52 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f Nov 05 17:44:52 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:52 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1a777233-1d0d-4d97-8bc8-09ea688ee80f" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Lock "cinder-quobyte-1a777233-1d0d-4d97-8bc8-09ea688ee80f" released by "delete_volume" :: held 0.816s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Acquiring lock "cinder-quobyte-8341557f-0f44-4d99-b7af-c17461ffb22a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Lock "cinder-quobyte-8341557f-0f44-4d99-b7af-c17461ffb22a" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad6e6ed-1807-41cb-9287-2234063c4ed7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:44:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:53 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a Nov 05 17:44:53 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:53 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a" returned: 0 in 0.509s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:53 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a Nov 05 17:44:53 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:53 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8341557f-0f44-4d99-b7af-c17461ffb22a" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Lock "cinder-quobyte-8341557f-0f44-4d99-b7af-c17461ffb22a" released by "delete_volume" :: held 0.916s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:44:53 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=111,cinder:INSERT=36,cinder:UPDATE=128,cinder:DELETE=10 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:44:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Created reservations ['552ee522-d8aa-4e28-94bc-d85db8b2f09f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:53 devstack cinder-volume[87126]: WARNING cinder.quota [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1354088515 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1354088515, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:44:53 devstack cinder-volume[87126]: WARNING cinder.quota [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1354088515 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1354088515, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:44:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Created reservations ['b22a3e0d-4668-44c9-bf0b-93a4fc6234d4', 'ea9d5519-a0a1-4c8a-8dde-e3531d1ccc85', 'b0ce2844-db20-49e2-a3fa-b0a96397ea02', '59d15773-9c04-49b7-a2ce-4e71e7d2bf2a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Created reservations ['2558f922-8bac-4bb6-81c2-7fe87e519896', 'bf8ab387-4dc7-423f-b322-7070e367b575', 'ecf91171-191c-4df3-b0e5-aa5a40f2cc0e', 'a2ac1d62-f77d-478e-821f-ead167dd700b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:44:54 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:44:54 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:44:54 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.461s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:44:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:44:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e7514b81-798c-465e-b345-adb7082fb28b tempest-GroupsTest-1342047154 None] Delete group completed successfully. Nov 05 17:45:04 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=71,cinder:INSERT=23,cinder:UPDATE=102,cinder:DELETE=4 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:45:04 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Flow 'volume_create_manager' (59a24f92-9f72-427a-b743-ea3632363bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb5ded3-a8c8-47ef-a64a-a148a4ec9620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb5ded3-a8c8-47ef-a64a-a148a4ec9620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-398125796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b771a2c9-2865-44f4-a0c3-ee07343b76c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3710570ea4fbd879f691946ee1a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:09Z,use_quota=True,user_id='d13bff1b127b4186b93e31f2778ec8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae905f9-14bb-4a58-8301-e76118a91606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae905f9-14bb-4a58-8301-e76118a91606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3f5423-ab2e-4d0e-b9fd-f03c6c7bd983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3f5423-ab2e-4d0e-b9fd-f03c6c7bd983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b771a2c9-2865-44f4-a0c3-ee07343b76c6', 'volume_name': 'volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af4662-4acd-4364-b157-ad5d7c446629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af4662-4acd-4364-b157-ad5d7c446629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559d34cb-a3f5-411d-8bca-08d148cf48ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Volume b771a2c9-2865-44f4-a0c3-ee07343b76c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6', 'volume_size': 1} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-398125796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b771a2c9-2865-44f4-a0c3-ee07343b76c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3710570ea4fbd879f691946ee1a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:09Z,use_quota=True,user_id='d13bff1b127b4186b93e31f2778ec8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Creating volume b771a2c9-2865-44f4-a0c3-ee07343b76c6 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:45:09 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:45:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:09 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 1073741824 Nov 05 17:45:09 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:10 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 1073741824" returned: 0 in 0.583s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:10 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 Nov 05 17:45:10 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:10 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559d34cb-a3f5-411d-8bca-08d148cf48ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e4e31f-f483-420a-97df-a7941b68b625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:10 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Volume volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 (b771a2c9-2865-44f4-a0c3-ee07343b76c6): created successfully Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e4e31f-f483-420a-97df-a7941b68b625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Flow 'volume_create_manager' (59a24f92-9f72-427a-b743-ea3632363bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-55e5c9b4-5673-4e7c-80a6-5f329e7a9f88 tempest-TestMinimumBasicScenario-2063595172 None] Created volume successfully. Nov 05 17:45:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fbd5b6ff-d9bf-4597-b714-43017e8af10c tempest-GroupsV314Test-95471766 None] Group tempest-GroupsV314Test-Group-469128156: creating Nov 05 17:45:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fbd5b6ff-d9bf-4597-b714-43017e8af10c tempest-GroupsV314Test-95471766 None] Group tempest-GroupsV314Test-Group-469128156: created successfully Nov 05 17:45:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fbd5b6ff-d9bf-4597-b714-43017e8af10c tempest-GroupsV314Test-95471766 None] Create group completed successfully. Nov 05 17:45:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e8e9fa06-19cc-4c62-868b-f0b2b3251d07 req-a86583f4-ab40-4639-a43c-9bdb659e8537 tempest-TestMinimumBasicScenario-2063595172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e8e9fa06-19cc-4c62-868b-f0b2b3251d07 req-a86583f4-ab40-4639-a43c-9bdb659e8537 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e8e9fa06-19cc-4c62-868b-f0b2b3251d07 req-a86583f4-ab40-4639-a43c-9bdb659e8537 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-e8e9fa06-19cc-4c62-868b-f0b2b3251d07 req-a86583f4-ab40-4639-a43c-9bdb659e8537 tempest-TestMinimumBasicScenario-2063595172 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe6107ac-bd7d-4c4f-937f-079ca307c82b', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:45:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-e8e9fa06-19cc-4c62-868b-f0b2b3251d07 req-a86583f4-ab40-4639-a43c-9bdb659e8537 tempest-TestMinimumBasicScenario-2063595172 None] attachment_update completed successfully. Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Flow 'volume_create_manager' (9342436f-1ba7-429a-a07c-167d5329dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151b0a9b-e70f-47aa-b9f9-60c61fdf4524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151b0a9b-e70f-47aa-b9f9-60c61fdf4524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-445454624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f90ab88-6eb3-4100-81b9-4ad2f40dfe8a,host='devstack@QuobyteHD#QuobyteHD',id=f60064a1-2418-42ab-90d2-f6aaed5cab3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48db1f2b48434743827d17f185be2f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:13Z,use_quota=True,user_id='984eadf1290a4238a1d5f24c08910e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf13b8f-ab73-4ba3-93ed-5d6ee280c372),volume_type_id=bcf13b8f-ab73-4ba3-93ed-5d6ee280c372)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d8c9b-78fb-4bb9-854e-aa08190f47cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d8c9b-78fb-4bb9-854e-aa08190f47cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f2e8c2-1f8f-4a12-9c66-e23ae1037cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f2e8c2-1f8f-4a12-9c66-e23ae1037cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60064a1-2418-42ab-90d2-f6aaed5cab3a', 'volume_name': 'volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f35a45-f8e8-404c-940b-43511a09f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f35a45-f8e8-404c-940b-43511a09f065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2865e9e8-e290-4c08-93f4-efacf8970685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Volume f60064a1-2418-42ab-90d2-f6aaed5cab3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a', 'volume_size': 1} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f90ab88-6eb3-4100-81b9-4ad2f40dfe8a,created_at=2026-11-05T16:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-445454624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f90ab88-6eb3-4100-81b9-4ad2f40dfe8a,host='devstack@QuobyteHD#QuobyteHD',id=f60064a1-2418-42ab-90d2-f6aaed5cab3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48db1f2b48434743827d17f185be2f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:13Z,use_quota=True,user_id='984eadf1290a4238a1d5f24c08910e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf13b8f-ab73-4ba3-93ed-5d6ee280c372),volume_type_id=bcf13b8f-ab73-4ba3-93ed-5d6ee280c372)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Creating volume f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:45:13 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:13 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a 1073741824 Nov 05 17:45:13 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:13 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:45:13 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:13 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a 1073741824" returned: 0 in 0.576s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:13 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a Nov 05 17:45:13 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:14 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.560s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:45:14 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a" returned: 0 in 0.555s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2865e9e8-e290-4c08-93f4-efacf8970685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2d6532-646f-4c52-9276-137141ed2920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Volume volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a (f60064a1-2418-42ab-90d2-f6aaed5cab3a): created successfully Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2d6532-646f-4c52-9276-137141ed2920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Flow 'volume_create_manager' (9342436f-1ba7-429a-a07c-167d5329dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0cc42cb9-8d2f-4a77-9444-697ae5dbafbc tempest-GroupsV314Test-95471766 None] Created volume successfully. Nov 05 17:45:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Cloning volume f60064a1-2418-42ab-90d2-f6aaed5cab3a to volume 8813cfa6-9179-4487-87c1-c2c57f49a241 Nov 05 17:45:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Creating offline snapshot 81aeb5cb-8f2e-407c-8b38-41355f83549a of volume f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:45:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711b0ef-2b54-4df6-9340-dc1abfaf96b0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:17 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a Nov 05 17:45:17 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:17 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a" returned: 0 in 0.499s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:17 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a 1G Nov 05 17:45:17 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:18 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a 1G" returned: 0 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:18 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a Nov 05 17:45:18 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:18 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a" returned: 0 in 0.411s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:45:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:18 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a Nov 05 17:45:18 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:18 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a" returned: 0 in 0.337s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:18 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.info Nov 05 17:45:18 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:19 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.info" returned: 0 in 0.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:19 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:19 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.info Nov 05 17:45:19 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:19 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.info" returned: 0 in 0.448s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Acquiring lock "cinder-quobyte-8813cfa6-9179-4487-87c1-c2c57f49a241" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-8813cfa6-9179-4487-87c1-c2c57f49a241" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] snapshot: 81aeb5cb-8f2e-407c-8b38-41355f83549a, volume: 8813cfa6-9179-4487-87c1-c2c57f49a241, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[43db7be5-efd3-49c7-8efd-f62e0900c3f8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:20 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a Nov 05 17:45:20 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:20 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a" returned: 0 in 0.580s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:45:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5fd65e-9129-4b93-bd40-9b316835c0a1]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:20 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a Nov 05 17:45:20 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:21 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:45:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:45:21 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:45:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:21 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 Nov 05 17:45:21 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Flow 'volume_create_manager' (525441da-3eaf-444f-a847-e06e80bdc8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58aec41a-8070-4e37-8a90-067b785e6a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58aec41a-8070-4e37-8a90-067b785e6a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1549660032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa58e240-2fd1-49ca-a684-44bb86c011c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27e5dbf276a4f0aabc3fe5888b37c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:26Z,use_quota=True,user_id='d72900c48f3b4d6cbe62f80271a2d5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b06a6e-315b-4e74-bce1-bc9141f55874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b06a6e-315b-4e74-bce1-bc9141f55874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ea96bf-5325-4d4e-911a-902c84c761ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ea96bf-5325-4d4e-911a-902c84c761ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa58e240-2fd1-49ca-a684-44bb86c011c9', 'volume_name': 'volume-aa58e240-2fd1-49ca-a684-44bb86c011c9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf2fbdb-e103-4e4a-9fa7-e5fedfc09dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf2fbdb-e103-4e4a-9fa7-e5fedfc09dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d2fe0d-5730-4313-adea-20a82c84e5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Volume aa58e240-2fd1-49ca-a684-44bb86c011c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa58e240-2fd1-49ca-a684-44bb86c011c9', 'volume_size': 1} Nov 05 17:45:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:30 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241" returned: 0 in 9.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:45:30 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Converted 1024.00 MB image at 110.22 MB/s Nov 05 17:45:30 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:30 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 Nov 05 17:45:30 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:30 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-8813cfa6-9179-4487-87c1-c2c57f49a241" released by "_copy_volume_from_snapshot" :: held 10.787s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Acquiring lock "cinder-quobyte-81aeb5cb-8f2e-407c-8b38-41355f83549a" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-81aeb5cb-8f2e-407c-8b38-41355f83549a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Deleting offline snapshot 81aeb5cb-8f2e-407c-8b38-41355f83549a of volume f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] snapshot_file for this snap is: volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a050d5-791d-465d-b651-29e8b34fa923]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Flow 'volume_create_manager' (9287e6ef-f69e-49cc-9a4f-9c16a7c081c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ed775c-8992-4dc9-ba06-a37f7e9026f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:30 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a Nov 05 17:45:30 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ed775c-8992-4dc9-ba06-a37f7e9026f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-511553823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5ebfd6-a3a7-4967-b7d6-be478bb92afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dbc534aa38408db57b89ae996c9060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:31Z,use_quota=True,user_id='827315a3af3541668625cb84b4d28af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9079ecdc-d7ee-4835-90aa-158721911645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9079ecdc-d7ee-4835-90aa-158721911645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638ed127-499b-4feb-aa03-6152d26ed16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:30 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:45:31 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f3a1bc-42c1-48ab-966f-570921a3c09a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638ed127-499b-4feb-aa03-6152d26ed16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e5ebfd6-a3a7-4967-b7d6-be478bb92afb', 'volume_name': 'volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c157c3-42db-4ed2-8345-6305287ab8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c157c3-42db-4ed2-8345-6305287ab8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e6860b-8ee2-4696-b4f5-3f6f32cb8a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Volume 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Trying to clone 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:45:31 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a Nov 05 17:45:31 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:45:31 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Image download 20.69 MB at 20.69 MB/s Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafb8be1-70d6-4060-9494-92c813bad387]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:31 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a" returned: 0 in 0.568s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:31 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD Nov 05 17:45:31 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:31 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a Nov 05 17:45:31 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:31 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:31 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a is fetched for user 827315a3af3541668625cb84b4d28af0. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6e2d7-1c24-4a95-9970-ce21f6a978cc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:32 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:32 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a Nov 05 17:45:32 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:32 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD Nov 05 17:45:32 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:32 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a.81aeb5cb-8f2e-407c-8b38-41355f83549a" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:32 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-81aeb5cb-8f2e-407c-8b38-41355f83549a" released by "_delete_snapshot" :: held 1.658s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.488s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.900s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1549660032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa58e240-2fd1-49ca-a684-44bb86c011c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27e5dbf276a4f0aabc3fe5888b37c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:26Z,use_quota=True,user_id='d72900c48f3b4d6cbe62f80271a2d5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Creating volume aa58e240-2fd1-49ca-a684-44bb86c011c9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:45:32 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:32 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 1073741824 Nov 05 17:45:32 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-38fecebc-cb13-43d1-8afb-1a3b3266c202 tempest-GroupsV314Test-95471766 None] Create group from source-group-8f90ab88-6eb3-4100-81b9-4ad2f40dfe8a completed successfully. Nov 05 17:45:32 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 1073741824" returned: 0 in 0.469s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:32 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 Nov 05 17:45:32 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:33 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-511553823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5ebfd6-a3a7-4967-b7d6-be478bb92afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4dbc534aa38408db57b89ae996c9060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:31Z,use_quota=True,user_id='827315a3af3541668625cb84b4d28af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Creating volume 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:45:33 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:33 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb 1073741824 Nov 05 17:45:33 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d2fe0d-5730-4313-adea-20a82c84e5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa58e240-2fd1-49ca-a684-44bb86c011c9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a10203f-0bc1-493a-85cd-befb17c3f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Volume volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 (aa58e240-2fd1-49ca-a684-44bb86c011c9): created successfully Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a10203f-0bc1-493a-85cd-befb17c3f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Flow 'volume_create_manager' (525441da-3eaf-444f-a847-e06e80bdc8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6887a918-9cff-46b0-9dde-f1d20d54f119 tempest-AttachVolumeTestJSON-1966362438 None] Created volume successfully. Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Acquiring lock "cinder-quobyte-8813cfa6-9179-4487-87c1-c2c57f49a241" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-8813cfa6-9179-4487-87c1-c2c57f49a241" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3f7b2-b303-4d79-8d06-f85b364b5e56]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:33 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 Nov 05 17:45:33 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:33 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb 1073741824" returned: 0 in 0.518s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:33 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb Nov 05 17:45:33 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:34 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241" returned: 0 in 0.596s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:34 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241 Nov 05 17:45:34 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:34 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Attempting download of 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a20aa73-988f-4817-bd76-172ee61f4854]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_s5qsv7ju {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:34 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8813cfa6-9179-4487-87c1-c2c57f49a241" returned: 0 in 0.430s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-8813cfa6-9179-4487-87c1-c2c57f49a241" released by "delete_volume" :: held 1.092s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:34 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_s5qsv7ju Nov 05 17:45:34 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Created reservations ['7e07b0ea-ac59-40c5-8213-d350f8f92020'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:34 devstack cinder-volume[87126]: WARNING cinder.quota [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-371194699 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-371194699, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:45:34 devstack cinder-volume[87126]: WARNING cinder.quota [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-371194699 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-371194699, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:45:34 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Created reservations ['9f5143e0-c0be-4ee5-ab5e-3fe407e68fae', 'da26849b-ad0f-41af-9ae7-3fc42e9d4fdd', 'd14d01f1-c539-4a0a-a635-39c9f95c04ab', '6137c248-eefb-4128-9f42-8fd2b5518314'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_s5qsv7ju" returned: 0 in 0.567s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_s5qsv7ju {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:35 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_s5qsv7ju Nov 05 17:45:35 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7354b282-eba0-4887-8f8e-d8bd93f40b50 req-1fd37d9b-57da-4e0a-a11b-d7b158493367 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7354b282-eba0-4887-8f8e-d8bd93f40b50 req-1fd37d9b-57da-4e0a-a11b-d7b158493367 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:35 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_s5qsv7ju" returned: 1 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a_s5qsv7ju' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb48f0fb-d74e-460f-876b-670d727c2955]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7354b282-eba0-4887-8f8e-d8bd93f40b50 req-1fd37d9b-57da-4e0a-a11b-d7b158493367 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.086s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:35 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:35 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:35 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:45:35 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-7354b282-eba0-4887-8f8e-d8bd93f40b50 req-1fd37d9b-57da-4e0a-a11b-d7b158493367 tempest-AttachVolumeTestJSON-1966362438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-aa58e240-2fd1-49ca-a684-44bb86c011c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aab30b16-dfd1-40d9-bb15-ee81d5061b47', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:45:35 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] 801ade9d-3bc5-40a6-b715-627da3a7cb0a was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:45:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7354b282-eba0-4887-8f8e-d8bd93f40b50 req-1fd37d9b-57da-4e0a-a11b-d7b158493367 tempest-AttachVolumeTestJSON-1966362438 None] attachment_update completed successfully. Nov 05 17:45:35 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb Nov 05 17:45:35 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:36 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.626s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:36 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:45:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c81443d6-3468-4b30-956b-94bef6f39777 tempest-GroupsV314Test-95471766 None] Delete group completed successfully. Nov 05 17:45:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Acquiring lock "cinder-quobyte-f60064a1-2418-42ab-90d2-f6aaed5cab3a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-f60064a1-2418-42ab-90d2-f6aaed5cab3a" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[30669a51-9925-4f94-8e4d-94977eb76489]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:37 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a Nov 05 17:45:37 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:37 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a" returned: 0 in 0.578s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:37 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a Nov 05 17:45:37 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Flow 'volume_create_manager' (fcb3756c-1622-42ca-8d28-8839dad3ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfc9c45-3b0d-4ba6-aaa9-62a4e0c5c96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:38 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f60064a1-2418-42ab-90d2-f6aaed5cab3a" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfc9c45-3b0d-4ba6-aaa9-62a4e0c5c96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-786507133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b090ea-a23e-4921-8cfd-f19b55dfcd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27e5dbf276a4f0aabc3fe5888b37c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:38Z,use_quota=True,user_id='d72900c48f3b4d6cbe62f80271a2d5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bda28a1-84d5-41fb-a8d3-ce28f438d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bda28a1-84d5-41fb-a8d3-ce28f438d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c58e58c-31d2-48b7-a86e-143f3659b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c58e58c-31d2-48b7-a86e-143f3659b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b090ea-a23e-4921-8cfd-f19b55dfcd39', 'volume_name': 'volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16465377-14bb-43b6-9a25-22f8f2c4c958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16465377-14bb-43b6-9a25-22f8f2c4c958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc8580d-02f7-4d7b-8b50-9cd24c7a87d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Volume 16b090ea-a23e-4921-8cfd-f19b55dfcd39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39', 'volume_size': 1} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-786507133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b090ea-a23e-4921-8cfd-f19b55dfcd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27e5dbf276a4f0aabc3fe5888b37c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:45:38Z,use_quota=True,user_id='d72900c48f3b4d6cbe62f80271a2d5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Creating volume 16b090ea-a23e-4921-8cfd-f19b55dfcd39 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:45:38 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Lock "cinder-quobyte-f60064a1-2418-42ab-90d2-f6aaed5cab3a" released by "delete_volume" :: held 1.223s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:38 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 1073741824 Nov 05 17:45:38 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Created reservations ['b3f6c15a-f8da-49c7-a69e-a162acc95449'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Created reservations ['8311815d-0382-4a12-bc9e-ae8d6560c9b6', '9b67060f-7909-4cfd-b0e1-8fa7c948979c', '44ee1e7c-c417-48fd-b665-452d81d6c529', '82ae66b6-c524-4642-8953-a3e74e436200'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:38 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:45:38 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:38 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb" returned: 0 in 2.929s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_sibqd9modevstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:45:38 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Converted 112.00 MB image at 38.20 MB/s Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:38 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb 1G Nov 05 17:45:38 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:38 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.321s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:45:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c9ae231a-f5c8-4e9e-a71a-2828736dd681 tempest-GroupsV314Test-95471766 None] Delete group completed successfully. Nov 05 17:45:38 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 1073741824" returned: 0 in 0.689s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:38 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 Nov 05 17:45:38 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:39 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb 1G" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Downloaded image 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a for user 827315a3af3541668625cb84b4d28af0 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Marking volume 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Copying metadata from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a to 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Creating volume glance metadata for volume 8e5ebfd6-a3a7-4967-b7d6-be478bb92afb backed by image 801ade9d-3bc5-40a6-b715-627da3a7cb0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:45:39 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc8580d-02f7-4d7b-8b50-9cd24c7a87d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f961458a-3824-4757-a114-9f928cd63c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Volume volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 (16b090ea-a23e-4921-8cfd-f19b55dfcd39): created successfully Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f961458a-3824-4757-a114-9f928cd63c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Flow 'volume_create_manager' (fcb3756c-1622-42ca-8d28-8839dad3ce23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-28a9a293-8441-4dc9-9750-1ae3c4c19814 tempest-AttachVolumeTestJSON-1966362438 None] Created volume successfully. Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e6860b-8ee2-4696-b4f5-3f6f32cb8a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8927a353-fe79-4580-81ac-be21bab66f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:45:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Volume volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb (8e5ebfd6-a3a7-4967-b7d6-be478bb92afb): created successfully Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8927a353-fe79-4580-81ac-be21bab66f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:45:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Flow 'volume_create_manager' (9287e6ef-f69e-49cc-9a4f-9c16a7c081c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:45:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2f55d174-9ff8-43da-b3c7-818b1ff4c30f tempest-TestShelveInstance-1266827594 None] Created volume successfully. Nov 05 17:45:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b2a50d6d-fb6f-4960-85f8-91ac6d84c6a0 req-d13321ae-aaf7-4b5f-93c4-f27c80627594 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b2a50d6d-fb6f-4960-85f8-91ac6d84c6a0 req-d13321ae-aaf7-4b5f-93c4-f27c80627594 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b2a50d6d-fb6f-4960-85f8-91ac6d84c6a0 req-d13321ae-aaf7-4b5f-93c4-f27c80627594 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-b2a50d6d-fb6f-4960-85f8-91ac6d84c6a0 req-d13321ae-aaf7-4b5f-93c4-f27c80627594 tempest-AttachVolumeTestJSON-1966362438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccf0e1fa-dad8-40ea-b2dd-df90517aa535', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:45:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-b2a50d6d-fb6f-4960-85f8-91ac6d84c6a0 req-d13321ae-aaf7-4b5f-93c4-f27c80627594 tempest-AttachVolumeTestJSON-1966362438 None] attachment_update completed successfully. Nov 05 17:45:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-91cb42f7-c357-448f-a8e9-c9f33fa99184 req-ce3fecda-0ae3-4536-bdc7-358855b5c841 tempest-TestShelveInstance-1266827594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-91cb42f7-c357-448f-a8e9-c9f33fa99184 req-ce3fecda-0ae3-4536-bdc7-358855b5c841 tempest-TestShelveInstance-1266827594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-91cb42f7-c357-448f-a8e9-c9f33fa99184 req-ce3fecda-0ae3-4536-bdc7-358855b5c841 tempest-TestShelveInstance-1266827594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-91cb42f7-c357-448f-a8e9-c9f33fa99184 req-ce3fecda-0ae3-4536-bdc7-358855b5c841 tempest-TestShelveInstance-1266827594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd89f6961-b187-45d1-aa70-a3ecae48c7d3', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:45:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-91cb42f7-c357-448f-a8e9-c9f33fa99184 req-ce3fecda-0ae3-4536-bdc7-358855b5c841 tempest-TestShelveInstance-1266827594 None] attachment_update completed successfully. Nov 05 17:45:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-b3686d80-a489-41ed-af3f-994109741456 req-78c70994-52a6-4e2f-b70a-98ad74470a8b tempest-AttachVolumeTestJSON-1966362438 None] Terminate volume connection completed successfully. Nov 05 17:45:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-b3686d80-a489-41ed-af3f-994109741456 req-78c70994-52a6-4e2f-b70a-98ad74470a8b tempest-AttachVolumeTestJSON-1966362438 None] Deleting attachment aab30b16-dfd1-40d9-bb15-ee81d5061b47. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:45:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-661f928e-7a2a-431e-9f77-9285d747f85b req-807553a5-2577-4af8-a3d4-6c29de18b80c tempest-AttachVolumeTestJSON-1966362438 None] Terminate volume connection completed successfully. Nov 05 17:45:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-661f928e-7a2a-431e-9f77-9285d747f85b req-807553a5-2577-4af8-a3d4-6c29de18b80c tempest-AttachVolumeTestJSON-1966362438 None] Deleting attachment ccf0e1fa-dad8-40ea-b2dd-df90517aa535. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:45:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-37f3b1aa-dbcd-4dc2-877f-183ee21caaaf tempest-GroupsV320Test-243252465 None] Group tempest-GroupsV320Test-Group-172215597: creating Nov 05 17:45:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-37f3b1aa-dbcd-4dc2-877f-183ee21caaaf tempest-GroupsV320Test-243252465 None] Group tempest-GroupsV320Test-Group-172215597: created successfully Nov 05 17:45:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-37f3b1aa-dbcd-4dc2-877f-183ee21caaaf tempest-GroupsV320Test-243252465 None] Create group completed successfully. Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Created reservations ['67d956a6-a288-474d-a3ec-35f199117126'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:50 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:45:50 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:50 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:50 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:45:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7cd0d682-b450-4ca9-82d3-c11a7b85a6fa tempest-GroupsV320Test-243252465 None] Delete group completed successfully. Nov 05 17:45:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "cinder-16b090ea-a23e-4921-8cfd-f19b55dfcd39-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-16b090ea-a23e-4921-8cfd-f19b55dfcd39-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "cinder-quobyte-16b090ea-a23e-4921-8cfd-f19b55dfcd39" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-quobyte-16b090ea-a23e-4921-8cfd-f19b55dfcd39" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3011ffa-534c-41f0-875d-e68998344779]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:52 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 Nov 05 17:45:52 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:53 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39" returned: 0 in 0.640s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:53 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39 Nov 05 17:45:53 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:53 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-16b090ea-a23e-4921-8cfd-f19b55dfcd39" returned: 0 in 0.547s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-quobyte-16b090ea-a23e-4921-8cfd-f19b55dfcd39" released by "delete_volume" :: held 1.294s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Created reservations ['0ab3dce5-da4c-4b1a-ba62-502537464dcd', '8acccb27-6ed9-4f22-8b5f-62d757891a07', '7e10b2f7-7983-4fdc-b364-e1b02b0818a6', 'b3bfa982-478f-4672-86d3-2ada2e15817f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:54 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:45:54 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:54 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:45:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Deleted volume successfully. Nov 05 17:45:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cad1ca54-b9ec-4001-b7b9-280c9cce0727 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-16b090ea-a23e-4921-8cfd-f19b55dfcd39-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "cinder-aa58e240-2fd1-49ca-a684-44bb86c011c9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-aa58e240-2fd1-49ca-a684-44bb86c011c9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "cinder-quobyte-aa58e240-2fd1-49ca-a684-44bb86c011c9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-quobyte-aa58e240-2fd1-49ca-a684-44bb86c011c9" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0293d3ee-90f8-4452-a15d-8af98c0eae4a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:55 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 Nov 05 17:45:55 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:56 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9" returned: 0 in 0.696s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:56 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9 Nov 05 17:45:56 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:56 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-aa58e240-2fd1-49ca-a684-44bb86c011c9" returned: 0 in 0.425s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-quobyte-aa58e240-2fd1-49ca-a684-44bb86c011c9" released by "delete_volume" :: held 1.243s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Created reservations ['ca6b49e7-4126-43c8-991f-396dfbf40239', '28c951dd-0dbd-4dad-83b3-b894cda2f964', 'c4b3d8df-d157-4e09-bb14-6b0056cce3ed', 'b2976001-a44d-400a-9df7-2cefc5de639d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:56 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:45:56 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:57 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.331s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:45:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Deleted volume successfully. Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99b82ccc-8d1e-4d50-ae2c-1f1f51d8e51d tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-aa58e240-2fd1-49ca-a684-44bb86c011c9-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "cinder-4c79b1c1-acae-49fe-85eb-c35545b4cb0e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-4c79b1c1-acae-49fe-85eb-c35545b4cb0e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "cinder-quobyte-4c79b1c1-acae-49fe-85eb-c35545b4cb0e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-quobyte-4c79b1c1-acae-49fe-85eb-c35545b4cb0e" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[39405eb4-49a6-4e01-9a59-3d48ae3dda70]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:45:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:57 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e Nov 05 17:45:57 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:58 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e" returned: 0 in 0.431s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:58 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e Nov 05 17:45:58 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:58 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4c79b1c1-acae-49fe-85eb-c35545b4cb0e" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-quobyte-4c79b1c1-acae-49fe-85eb-c35545b4cb0e" released by "delete_volume" :: held 0.838s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Created reservations ['b54692c6-5a83-49e7-b358-eec0dc695a65', 'd5036e2f-0049-4536-8cbc-251d919af758', '9dd293d6-3125-413b-9876-58c66b45851e', '1b53eda7-992f-412b-af91-533cc37275ba'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:45:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:45:58 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:45:58 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:45:59 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Nov 05 17:45:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.458s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:45:59 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:45:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Deleted volume successfully. Nov 05 17:45:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-461c322e-f2dd-48dd-9349-9b35b4450cd1 tempest-AttachVolumeTestJSON-1966362438 None] Lock "cinder-4c79b1c1-acae-49fe-85eb-c35545b4cb0e-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-491ccc5a-5ee9-4622-ba6a-341dee3bdfe3 req-d2edd911-89bb-4489-968f-90d030b692c1 tempest-TestMinimumBasicScenario-2063595172 None] Terminate volume connection completed successfully. Nov 05 17:46:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-491ccc5a-5ee9-4622-ba6a-341dee3bdfe3 req-d2edd911-89bb-4489-968f-90d030b692c1 tempest-TestMinimumBasicScenario-2063595172 None] Deleting attachment fe6107ac-bd7d-4c4f-937f-079ca307c82b. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:46:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Acquiring lock "cinder-b771a2c9-2865-44f4-a0c3-ee07343b76c6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Lock "cinder-b771a2c9-2865-44f4-a0c3-ee07343b76c6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Acquiring lock "cinder-quobyte-b771a2c9-2865-44f4-a0c3-ee07343b76c6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Lock "cinder-quobyte-b771a2c9-2865-44f4-a0c3-ee07343b76c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[410fdd29-6897-43a5-a6b0-ac6a8aa5f2fc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:03 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 Nov 05 17:46:03 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:03 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6" returned: 0 in 0.489s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:03 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6 Nov 05 17:46:03 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:03 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b771a2c9-2865-44f4-a0c3-ee07343b76c6" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Lock "cinder-quobyte-b771a2c9-2865-44f4-a0c3-ee07343b76c6" released by "delete_volume" :: held 0.927s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Created reservations ['518010e2-6f2a-4595-a5fc-c2dbef61d0a8', '0db0b6a7-9369-4a12-b6e2-5fe1019a5ac5', '68ac64af-ed2c-4149-a9cb-373849c81182', '0d6d2f98-fa1a-449e-a299-2f2e4cd7fa24'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:03 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:03 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:04 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:04 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Deleted volume successfully. Nov 05 17:46:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bc69a332-f895-4d8a-b5d0-2aec04bd4dc1 tempest-TestMinimumBasicScenario-2063595172 None] Lock "cinder-b771a2c9-2865-44f4-a0c3-ee07343b76c6-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=101,cinder:INSERT=30,cinder:UPDATE=81,cinder:DELETE=4 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=88,cinder:SELECT=96,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Flow 'volume_create_manager' (b608bcae-31b0-4486-8d5c-6d607f8915c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10608f0a-5e7d-48ff-90cd-1cea4a4ebae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10608f0a-5e7d-48ff-90cd-1cea4a4ebae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-891411527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68604e81-17f2-4c80-95be-99a81731bcb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed04b7bd33934b8dbe2cbc26c6305229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:11Z,use_quota=True,user_id='29fe313923fd4dc69da6729018319152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd002b13-136f-4c24-af5d-4e7f93200655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd002b13-136f-4c24-af5d-4e7f93200655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba6690e-54e9-4536-ac41-9853ab92f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba6690e-54e9-4536-ac41-9853ab92f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68604e81-17f2-4c80-95be-99a81731bcb6', 'volume_name': 'volume-68604e81-17f2-4c80-95be-99a81731bcb6', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4653cfb-445a-43cf-9346-91d86ea3d613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4653cfb-445a-43cf-9346-91d86ea3d613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3d3b65-b89e-480f-beae-c03f46f4cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:11 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Volume 68604e81-17f2-4c80-95be-99a81731bcb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68604e81-17f2-4c80-95be-99a81731bcb6', 'volume_size': 1} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-891411527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68604e81-17f2-4c80-95be-99a81731bcb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed04b7bd33934b8dbe2cbc26c6305229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:11Z,use_quota=True,user_id='29fe313923fd4dc69da6729018319152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Creating volume 68604e81-17f2-4c80-95be-99a81731bcb6 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:46:11 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:11 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 1073741824 Nov 05 17:46:11 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:11 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 1073741824" returned: 0 in 0.501s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:11 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 Nov 05 17:46:11 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:12 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:46:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3d3b65-b89e-480f-beae-c03f46f4cd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68604e81-17f2-4c80-95be-99a81731bcb6', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701f0994-e543-4f7f-9a92-7a18ad5ee8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Volume volume-68604e81-17f2-4c80-95be-99a81731bcb6 (68604e81-17f2-4c80-95be-99a81731bcb6): created successfully Nov 05 17:46:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701f0994-e543-4f7f-9a92-7a18ad5ee8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Flow 'volume_create_manager' (b608bcae-31b0-4486-8d5c-6d607f8915c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a7812e0b-33d1-48c0-a5fd-1dd39e9df01a tempest-VolumesTestJSON-740969322 None] Created volume successfully. Nov 05 17:46:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:46:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:13 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:13 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Flow 'volume_create_manager' (0cae969e-a847-4d5f-89dd-006f6c4f6095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51812818-aca1-4a49-81b2-17d124fe28d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51812818-aca1-4a49-81b2-17d124fe28d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-970116651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e236233-6d22-4ded-980a-92e88178c72e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed04b7bd33934b8dbe2cbc26c6305229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:14Z,use_quota=True,user_id='29fe313923fd4dc69da6729018319152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411ac292-a392-48f6-bddd-82e08fefd61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411ac292-a392-48f6-bddd-82e08fefd61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68027fa2-7559-4ffb-9f14-91de9b5b4165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68027fa2-7559-4ffb-9f14-91de9b5b4165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e236233-6d22-4ded-980a-92e88178c72e', 'volume_name': 'volume-1e236233-6d22-4ded-980a-92e88178c72e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9ce0c5-2a70-4699-b460-143b689324ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9ce0c5-2a70-4699-b460-143b689324ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6113bc6-61bf-4317-aac5-3519e5a17201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Volume 1e236233-6d22-4ded-980a-92e88178c72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e236233-6d22-4ded-980a-92e88178c72e', 'volume_size': 1} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-970116651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e236233-6d22-4ded-980a-92e88178c72e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed04b7bd33934b8dbe2cbc26c6305229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:14Z,use_quota=True,user_id='29fe313923fd4dc69da6729018319152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Creating volume 1e236233-6d22-4ded-980a-92e88178c72e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:46:14 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:14 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e 1073741824 Nov 05 17:46:14 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:14 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.550s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:46:14 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e 1073741824" returned: 0 in 0.672s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:14 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e Nov 05 17:46:14 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:15 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:46:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6113bc6-61bf-4317-aac5-3519e5a17201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e236233-6d22-4ded-980a-92e88178c72e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05a17cb-f2ae-4df5-b302-2b2dc12d88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Volume volume-1e236233-6d22-4ded-980a-92e88178c72e (1e236233-6d22-4ded-980a-92e88178c72e): created successfully Nov 05 17:46:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05a17cb-f2ae-4df5-b302-2b2dc12d88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Flow 'volume_create_manager' (0cae969e-a847-4d5f-89dd-006f6c4f6095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-32df438d-5230-425a-be37-e624fe5b0abc tempest-VolumesTestJSON-740969322 None] Created volume successfully. Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Flow 'volume_create_manager' (1f3c63c8-bbe6-46f0-a193-b05b73e47c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa1aa75-1ecb-4522-839a-e8465e2216f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa1aa75-1ecb-4522-839a-e8465e2216f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562314165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf63f1e3-e675-4558-87a5-138c1a049776,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed04b7bd33934b8dbe2cbc26c6305229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:17Z,use_quota=True,user_id='29fe313923fd4dc69da6729018319152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4da88bb-5fda-4af7-be26-8327744cad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4da88bb-5fda-4af7-be26-8327744cad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b965979b-7ba1-4145-b963-802d5a1d267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b965979b-7ba1-4145-b963-802d5a1d267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf63f1e3-e675-4558-87a5-138c1a049776', 'volume_name': 'volume-bf63f1e3-e675-4558-87a5-138c1a049776', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f223ec96-a11d-4277-8989-46084641f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f223ec96-a11d-4277-8989-46084641f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54307ab-8855-42ac-ad8b-6d52629cb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Volume bf63f1e3-e675-4558-87a5-138c1a049776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf63f1e3-e675-4558-87a5-138c1a049776', 'volume_size': 1} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562314165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf63f1e3-e675-4558-87a5-138c1a049776,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed04b7bd33934b8dbe2cbc26c6305229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:17Z,use_quota=True,user_id='29fe313923fd4dc69da6729018319152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Creating volume bf63f1e3-e675-4558-87a5-138c1a049776 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:46:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:17 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 1073741824 Nov 05 17:46:17 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:17 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 1073741824" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:17 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 Nov 05 17:46:17 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:18 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:46:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54307ab-8855-42ac-ad8b-6d52629cb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf63f1e3-e675-4558-87a5-138c1a049776', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe31c802-e656-4d44-8d18-3f5051aa8092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Volume volume-bf63f1e3-e675-4558-87a5-138c1a049776 (bf63f1e3-e675-4558-87a5-138c1a049776): created successfully Nov 05 17:46:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe31c802-e656-4d44-8d18-3f5051aa8092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Flow 'volume_create_manager' (1f3c63c8-bbe6-46f0-a193-b05b73e47c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-12c4b250-23bb-4fb6-b88a-331d94a99dc1 tempest-VolumesTestJSON-740969322 None] Created volume successfully. Nov 05 17:46:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-ec630c67-5c97-400f-81cb-781ea45e1ce6 req-d7508106-f003-4276-af8b-1095109470f7 tempest-TestShelveInstance-1266827594 None] Terminate volume connection completed successfully. Nov 05 17:46:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-ec630c67-5c97-400f-81cb-781ea45e1ce6 req-d7508106-f003-4276-af8b-1095109470f7 tempest-TestShelveInstance-1266827594 None] Deleting attachment d89f6961-b187-45d1-aa70-a3ecae48c7d3. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:46:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Acquiring lock "cinder-bf63f1e3-e675-4558-87a5-138c1a049776-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Lock "cinder-bf63f1e3-e675-4558-87a5-138c1a049776-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Acquiring lock "cinder-quobyte-bf63f1e3-e675-4558-87a5-138c1a049776" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Lock "cinder-quobyte-bf63f1e3-e675-4558-87a5-138c1a049776" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aa0668-35ed-45fa-a3fe-5aee5f56bb82]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:21 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 Nov 05 17:46:21 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:21 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:21 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776 Nov 05 17:46:21 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:21 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf63f1e3-e675-4558-87a5-138c1a049776" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Lock "cinder-quobyte-bf63f1e3-e675-4558-87a5-138c1a049776" released by "delete_volume" :: held 0.889s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Created reservations ['ce953b16-ff87-4d19-b11f-874dcbfc7159', '96691132-3024-467a-b40a-ec9fcacb041f', 'a50ef180-ed83-4844-b4ca-cea05c0e4acb', 'dcc68236-0af5-4b5b-9cd3-3eb77f9ef23c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:21 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:21 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Acquiring lock "cinder-1e236233-6d22-4ded-980a-92e88178c72e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Lock "cinder-1e236233-6d22-4ded-980a-92e88178c72e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Acquiring lock "cinder-quobyte-1e236233-6d22-4ded-980a-92e88178c72e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Lock "cinder-quobyte-1e236233-6d22-4ded-980a-92e88178c72e" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a09d9f-7766-466a-b07a-5d6c17d44850]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:22 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Deleted volume successfully. Nov 05 17:46:22 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ae6a0c-3e1f-491f-acfd-ac97886c1810 tempest-VolumesTestJSON-740969322 None] Lock "cinder-bf63f1e3-e675-4558-87a5-138c1a049776-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:22 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:22 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e" returned: 0 in 0.563s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:22 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e Nov 05 17:46:22 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:23 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e236233-6d22-4ded-980a-92e88178c72e" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Lock "cinder-quobyte-1e236233-6d22-4ded-980a-92e88178c72e" released by "delete_volume" :: held 0.964s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Created reservations ['26cbe17c-ff71-4b9c-837b-f9e0faac018f', '95ed0851-fc8d-425f-920d-a9fd65b8b84a', 'e232a471-7766-4d39-8230-c7d17724945f', 'f4918127-dff7-4afe-9fba-6b80beb9ebdf'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:23 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:23 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Flow 'volume_create_manager' (b8452bc0-b6c3-4da8-9a71-6fb9f33c6cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a78438c-ebfc-4e2c-9e3e-f95397ce38a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a78438c-ebfc-4e2c-9e3e-f95397ce38a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1904130693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c852eada-3d6b-490d-a47f-29624519ae89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daa23fd2bb8404287422d312e52c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:23Z,use_quota=True,user_id='14bcf4caa7824ae48c6fc11649ef1561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5972419c-2839-4ec5-9593-bc96cd732fe7),volume_type_id=5972419c-2839-4ec5-9593-bc96cd732fe7)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78ab89f-b52c-4e3d-875c-a580d07c8d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78ab89f-b52c-4e3d-875c-a580d07c8d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7355de-c2e9-460a-9258-63cb8710de35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7355de-c2e9-460a-9258-63cb8710de35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c852eada-3d6b-490d-a47f-29624519ae89', 'volume_name': 'volume-c852eada-3d6b-490d-a47f-29624519ae89', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad56731-5867-4435-93bc-2615355ce8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad56731-5867-4435-93bc-2615355ce8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14810322-4d54-4b00-820b-a493227b694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Volume c852eada-3d6b-490d-a47f-29624519ae89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c852eada-3d6b-490d-a47f-29624519ae89', 'volume_size': 1} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1904130693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c852eada-3d6b-490d-a47f-29624519ae89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daa23fd2bb8404287422d312e52c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:23Z,use_quota=True,user_id='14bcf4caa7824ae48c6fc11649ef1561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5972419c-2839-4ec5-9593-bc96cd732fe7),volume_type_id=5972419c-2839-4ec5-9593-bc96cd732fe7)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Creating volume c852eada-3d6b-490d-a47f-29624519ae89 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:46:23 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:23 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:23 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 1073741824 Nov 05 17:46:23 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Deleted volume successfully. Nov 05 17:46:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-99901b35-c1b1-4005-9954-1ef7baffbc17 tempest-VolumesTestJSON-740969322 None] Lock "cinder-1e236233-6d22-4ded-980a-92e88178c72e-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:24 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 1073741824" returned: 0 in 0.545s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:24 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 Nov 05 17:46:24 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Acquiring lock "cinder-68604e81-17f2-4c80-95be-99a81731bcb6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Lock "cinder-68604e81-17f2-4c80-95be-99a81731bcb6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Acquiring lock "cinder-quobyte-68604e81-17f2-4c80-95be-99a81731bcb6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Lock "cinder-quobyte-68604e81-17f2-4c80-95be-99a81731bcb6" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:24 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3125a16c-f241-435f-b0a4-1a8453d987a7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89" returned: 0 in 0.432s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f42e45b9-7458-4f3a-81e1-644d8c328667 req-1db3083d-00eb-44c0-8429-59fee77da6c6 tempest-TestShelveInstance-1266827594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f42e45b9-7458-4f3a-81e1-644d8c328667 req-1db3083d-00eb-44c0-8429-59fee77da6c6 tempest-TestShelveInstance-1266827594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14810322-4d54-4b00-820b-a493227b694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c852eada-3d6b-490d-a47f-29624519ae89', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa8f7e9-279a-4ce3-bfd1-13aaad71ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f42e45b9-7458-4f3a-81e1-644d8c328667 req-1db3083d-00eb-44c0-8429-59fee77da6c6 tempest-TestShelveInstance-1266827594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Volume volume-c852eada-3d6b-490d-a47f-29624519ae89 (c852eada-3d6b-490d-a47f-29624519ae89): created successfully Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa8f7e9-279a-4ce3-bfd1-13aaad71ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Flow 'volume_create_manager' (b8452bc0-b6c3-4da8-9a71-6fb9f33c6cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:24 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 Nov 05 17:46:24 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-f42e45b9-7458-4f3a-81e1-644d8c328667 req-1db3083d-00eb-44c0-8429-59fee77da6c6 tempest-TestShelveInstance-1266827594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '241c6f5a-a5b2-4509-8c99-1fe44acede0c', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:46:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-42a6968a-c711-4f06-adf3-d27c34dafbb2 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Created volume successfully. Nov 05 17:46:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-f42e45b9-7458-4f3a-81e1-644d8c328667 req-1db3083d-00eb-44c0-8429-59fee77da6c6 tempest-TestShelveInstance-1266827594 None] attachment_update completed successfully. Nov 05 17:46:25 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6" returned: 0 in 0.479s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:25 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6 Nov 05 17:46:25 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:25 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-68604e81-17f2-4c80-95be-99a81731bcb6" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Lock "cinder-quobyte-68604e81-17f2-4c80-95be-99a81731bcb6" released by "delete_volume" :: held 0.821s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Created reservations ['fd7004f9-aed1-438a-bb02-7aaaf5804339', 'f5f207a0-b2fc-4323-b853-5d77976d7240', 'b71eac29-f9cf-42dc-8dd9-8cc1ff6b70a9', 'b62af384-76d5-46ac-ac36-eceedd07d3c0'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:25 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:25 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:26 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.429s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Deleted volume successfully. Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c066098-cdc0-4a0a-a5f7-6dc30805b3a7 tempest-VolumesTestJSON-740969322 None] Lock "cinder-68604e81-17f2-4c80-95be-99a81731bcb6-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:26 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:26 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:26 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-219bd877-e7f6-4dbd-9765-4e3cad1dd324 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Retype volume completed successfully. Nov 05 17:46:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Acquiring lock "cinder-c852eada-3d6b-490d-a47f-29624519ae89-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "cinder-c852eada-3d6b-490d-a47f-29624519ae89-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Acquiring lock "cinder-quobyte-c852eada-3d6b-490d-a47f-29624519ae89" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "cinder-quobyte-c852eada-3d6b-490d-a47f-29624519ae89" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e54f1-27b7-4435-a8ac-9bdd2c63eea4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:27 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 Nov 05 17:46:27 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:28 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89" returned: 0 in 0.546s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:28 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89 Nov 05 17:46:28 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:28 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c852eada-3d6b-490d-a47f-29624519ae89" returned: 0 in 0.332s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "cinder-quobyte-c852eada-3d6b-490d-a47f-29624519ae89" released by "delete_volume" :: held 0.948s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:28 devstack cinder-volume[87126]: WARNING cinder.quota [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:46:28 devstack cinder-volume[87126]: WARNING cinder.quota [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Created reservations ['c8f0975e-e866-4ee7-a1bf-ea35a75f7218', '45d7a8b7-88f0-46e1-af23-e0af26afe7f5', 'db5f9b36-f588-4e46-8009-1f5c357dd1e5', 'bbf1819f-e708-442c-b72c-4d90dfa3413c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:28 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:28 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:29 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:29 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Deleted volume successfully. Nov 05 17:46:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4ba79046-8652-485f-8aef-051f5e286551 tempest-VolumeRetypeWithoutMigrationTest-1537482264 None] Lock "cinder-c852eada-3d6b-490d-a47f-29624519ae89-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:38 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=36,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:46:39 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=49,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=5 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:46:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-07b9b79b-870a-4beb-90c2-681420ec148d tempest-GroupSnapshotsV319Test-1220851927 None] Group tempest-GroupSnapshotsV319Test-Group-823004906: creating Nov 05 17:46:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-07b9b79b-870a-4beb-90c2-681420ec148d tempest-GroupSnapshotsV319Test-1220851927 None] Group tempest-GroupSnapshotsV319Test-Group-823004906: created successfully Nov 05 17:46:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-07b9b79b-870a-4beb-90c2-681420ec148d tempest-GroupSnapshotsV319Test-1220851927 None] Create group completed successfully. Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Flow 'volume_create_manager' (7319e483-f151-442e-bff1-4e8f82c32319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fbdba0-04f4-40c8-ad20-5211ed5ccebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fbdba0-04f4-40c8-ad20-5211ed5ccebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-268124571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8092a0b4-d21f-41cf-b296-7c83786321f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c933a1401b494d8a844dee20106d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:42Z,use_quota=True,user_id='6c5c50e4ca4144e299b2ec53741e8b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300e8863-a318-4016-864e-5b2d233ab853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300e8863-a318-4016-864e-5b2d233ab853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ddb27a-01de-4bb7-8d77-4154ee0a5e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ddb27a-01de-4bb7-8d77-4154ee0a5e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8092a0b4-d21f-41cf-b296-7c83786321f9', 'volume_name': 'volume-8092a0b4-d21f-41cf-b296-7c83786321f9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b2e54f-33ec-4f0b-8429-90769cc920ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b2e54f-33ec-4f0b-8429-90769cc920ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95ddcde-9c45-4093-8eef-07c8a9591a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Volume 8092a0b4-d21f-41cf-b296-7c83786321f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8092a0b4-d21f-41cf-b296-7c83786321f9', 'volume_size': 1} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-268124571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8092a0b4-d21f-41cf-b296-7c83786321f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c933a1401b494d8a844dee20106d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:42Z,use_quota=True,user_id='6c5c50e4ca4144e299b2ec53741e8b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Creating volume 8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:46:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:46:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:41 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 1073741824 Nov 05 17:46:41 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Flow 'volume_create_manager' (946232f5-d6c8-456e-b2f1-165d6caf2e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201ce426-4ce6-4f45-b0d7-5e5b606c0913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201ce426-4ce6-4f45-b0d7-5e5b606c0913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-463084518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7c1c72e-d5bd-4ae8-9b99-74a72ced135d,host='devstack@QuobyteHD#QuobyteHD',id=8b89fa1b-a22c-4f10-83cc-dcb80708b688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3c94d1f49c43819bb32b28a7b53609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:42Z,use_quota=True,user_id='55b77c10bd91457ab959310b3547d003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb9eb6b-78c0-44a6-8b8c-54226498c66e),volume_type_id=7fb9eb6b-78c0-44a6-8b8c-54226498c66e)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4885299-7da0-4313-ba46-4967a83284bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4885299-7da0-4313-ba46-4967a83284bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d35c80-89cc-4672-8b89-cd021a123506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d35c80-89cc-4672-8b89-cd021a123506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b89fa1b-a22c-4f10-83cc-dcb80708b688', 'volume_name': 'volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be79e043-27c6-4fbb-ab46-f94f3ac5ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be79e043-27c6-4fbb-ab46-f94f3ac5ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee872a3-5044-4388-a28c-c132959acf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Volume 8b89fa1b-a22c-4f10-83cc-dcb80708b688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688', 'volume_size': 1} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:42 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 1073741824" returned: 0 in 0.665s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:42 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 Nov 05 17:46:42 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:42 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9" returned: 0 in 0.286s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e7c1c72e-d5bd-4ae8-9b99-74a72ced135d,created_at=2026-11-05T16:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-463084518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7c1c72e-d5bd-4ae8-9b99-74a72ced135d,host='devstack@QuobyteHD#QuobyteHD',id=8b89fa1b-a22c-4f10-83cc-dcb80708b688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3c94d1f49c43819bb32b28a7b53609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:46:42Z,use_quota=True,user_id='55b77c10bd91457ab959310b3547d003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb9eb6b-78c0-44a6-8b8c-54226498c66e),volume_type_id=7fb9eb6b-78c0-44a6-8b8c-54226498c66e)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Creating volume 8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:46:42 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95ddcde-9c45-4093-8eef-07c8a9591a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8092a0b4-d21f-41cf-b296-7c83786321f9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d6a1f6-67b6-4c64-a799-a99b10e8de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:42 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 1073741824 Nov 05 17:46:42 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Volume volume-8092a0b4-d21f-41cf-b296-7c83786321f9 (8092a0b4-d21f-41cf-b296-7c83786321f9): created successfully Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d6a1f6-67b6-4c64-a799-a99b10e8de90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Flow 'volume_create_manager' (7319e483-f151-442e-bff1-4e8f82c32319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-38a37f88-4ec7-45f8-975d-f6e05e82d43c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Created volume successfully. Nov 05 17:46:43 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 1073741824" returned: 0 in 0.546s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:43 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 Nov 05 17:46:43 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:43 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee872a3-5044-4388-a28c-c132959acf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86d4395-d127-4e6a-8fdc-c52cdbe172a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:46:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Volume volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 (8b89fa1b-a22c-4f10-83cc-dcb80708b688): created successfully Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86d4395-d127-4e6a-8fdc-c52cdbe172a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:46:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Flow 'volume_create_manager' (946232f5-d6c8-456e-b2f1-165d6caf2e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:46:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-527dcddb-8990-4322-8bf6-cad33ce09800 tempest-GroupSnapshotsV319Test-1220851927 None] Created volume successfully. Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Creating offline snapshot e5d7343d-1d24-4242-b673-58dcb61bba86 of volume 8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb11305-a39f-473b-bc9e-720179a64c6c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:44 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 Nov 05 17:46:44 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:44 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9" returned: 0 in 0.427s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:44 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 1G Nov 05 17:46:44 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:44 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 1G" returned: 0 in 0.514s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8092a0b4-d21f-41cf-b296-7c83786321f9 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:45 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8092a0b4-d21f-41cf-b296-7c83786321f9 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 Nov 05 17:46:45 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] GroupSnapshot 9234afbd-f39e-4842-ac6d-10c4de420029: creating. Nov 05 17:46:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Group snapshot 9234afbd-f39e-4842-ac6d-10c4de420029: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 17:46:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:45 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8092a0b4-d21f-41cf-b296-7c83786321f9 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86" returned: 0 in 0.449s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 is being set with open permissions: ugo+rw Nov 05 17:46:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:45 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 Nov 05 17:46:45 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:45 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:45 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.info Nov 05 17:46:45 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:46 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.info" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:46 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.info is being set with open permissions: ugo+rw Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:46 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.info Nov 05 17:46:46 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:46 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.info" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.138s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Creating offline snapshot fd686eca-2c8d-4723-8b3f-506a084b0049 of volume 8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:46:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6575c8ea-96ae-4036-be77-0e9627a1f03f tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Create snapshot completed successfully Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d82ad3-4101-451c-8c7d-8b2b210d57f3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:46 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 Nov 05 17:46:46 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:46 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:46 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 1G Nov 05 17:46:46 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:47 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 1G" returned: 0 in 0.617s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:47 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 Nov 05 17:46:47 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:47 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "cinder-e5d7343d-1d24-4242-b673-58dcb61bba86-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049" returned: 0 in 0.507s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:48 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-e5d7343d-1d24-4242-b673-58dcb61bba86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "cinder-quobyte-8092a0b4-d21f-41cf-b296-7c83786321f9" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-quobyte-8092a0b4-d21f-41cf-b296-7c83786321f9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "cinder-quobyte-e5d7343d-1d24-4242-b673-58dcb61bba86" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:48 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 Nov 05 17:46:48 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-quobyte-e5d7343d-1d24-4242-b673-58dcb61bba86" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Deleting offline snapshot e5d7343d-1d24-4242-b673-58dcb61bba86 of volume 8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] snapshot_file for this snap is: volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bdff86-06bd-4404-9437-c00092f91856]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:48 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 Nov 05 17:46:48 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:48 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:48 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.info Nov 05 17:46:48 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:48 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86" returned: 0 in 0.511s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8092a0b4-d21f-41cf-b296-7c83786321f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:46:48 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.info" returned: 0 in 0.311s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:48 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6874eb49-178c-40e4-bed5-301269210efd]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:48 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.info Nov 05 17:46:48 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:48 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 Nov 05 17:46:48 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:49 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.info" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ddda4f48-4faf-400b-a444-7a59bd5ad4f4 tempest-GroupSnapshotsV319Test-1220851927 None] group_snapshot 9234afbd-f39e-4842-ac6d-10c4de420029: created successfully Nov 05 17:46:49 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9" returned: 0 in 0.472s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:49 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 Nov 05 17:46:49 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:49 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86" returned: 0 in 0.419s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:49 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86 Nov 05 17:46:49 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:49 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9.e5d7343d-1d24-4242-b673-58dcb61bba86" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-quobyte-e5d7343d-1d24-4242-b673-58dcb61bba86" released by "_delete_snapshot" :: held 1.917s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-quobyte-8092a0b4-d21f-41cf-b296-7c83786321f9" released by "delete_snapshot" :: held 1.956s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Created reservations ['b581f009-ecd9-44d7-8bde-578745f2787a', '93ea0125-5c24-436d-8c5d-ef54e28ba31d', '1463dfb9-7ddc-4f69-b357-4a0db6a15acf', '1a0e3819-ddd4-475b-a75a-033d39b4f0e3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Delete snapshot completed successfully. Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-261b2cf3-0407-4f5b-9d20-27c44a7f5c2c tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-e5d7343d-1d24-4242-b673-58dcb61bba86-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "cinder-8092a0b4-d21f-41cf-b296-7c83786321f9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-8092a0b4-d21f-41cf-b296-7c83786321f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] group_snapshot 9234afbd-f39e-4842-ac6d-10c4de420029: deleting Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] group_snapshot 9234afbd-f39e-4842-ac6d-10c4de420029: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "cinder-quobyte-8092a0b4-d21f-41cf-b296-7c83786321f9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Acquiring lock "cinder-quobyte-8b89fa1b-a22c-4f10-83cc-dcb80708b688" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-quobyte-8092a0b4-d21f-41cf-b296-7c83786321f9" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "cinder-quobyte-8b89fa1b-a22c-4f10-83cc-dcb80708b688" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Acquiring lock "cinder-quobyte-fd686eca-2c8d-4723-8b3f-506a084b0049" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "cinder-quobyte-fd686eca-2c8d-4723-8b3f-506a084b0049" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Deleting offline snapshot fd686eca-2c8d-4723-8b3f-506a084b0049 of volume 8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] snapshot_file for this snap is: volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f008659d-768c-411b-805a-bea9aa97fa77]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e30de9a-5f53-46f3-b270-fe12d04f7695]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:50 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 Nov 05 17:46:50 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:50 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 Nov 05 17:46:50 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:50 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9" returned: 0 in 0.408s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:51 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9 Nov 05 17:46:51 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:51 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049" returned: 0 in 0.439s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b043d8b-68c3-4f7e-976c-53cfbf72f864]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:51 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 Nov 05 17:46:51 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:51 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8092a0b4-d21f-41cf-b296-7c83786321f9" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-quobyte-8092a0b4-d21f-41cf-b296-7c83786321f9" released by "delete_volume" :: held 0.799s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Created reservations ['b7130425-73d6-4a67-9662-78f19489dbc9', '2ae90b6d-d28c-445c-a476-a5c1e14e778d', '8771c273-e6ce-4be7-8027-2599422e0ff0', '4436ef3b-76e5-47cc-ac08-4c71c70963f5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:51 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:51 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:51 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688" returned: 0 in 0.435s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:51 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 Nov 05 17:46:51 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:51 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Deleted volume successfully. Nov 05 17:46:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbfd9857-9d1a-442a-a602-f34f98992f4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1052678597 None] Lock "cinder-8092a0b4-d21f-41cf-b296-7c83786321f9-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:52 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049" returned: 0 in 0.540s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:52 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049 Nov 05 17:46:52 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:52 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688.fd686eca-2c8d-4723-8b3f-506a084b0049" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "cinder-quobyte-fd686eca-2c8d-4723-8b3f-506a084b0049" released by "_delete_snapshot" :: held 1.825s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "cinder-quobyte-8b89fa1b-a22c-4f10-83cc-dcb80708b688" released by "delete_snapshot" :: held 1.851s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:52 devstack cinder-volume[87126]: WARNING cinder.quota [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-596048071 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-596048071, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:46:52 devstack cinder-volume[87126]: WARNING cinder.quota [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-596048071 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-596048071, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:46:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] Created reservations ['586f7403-3bd2-44ba-b103-127a75552e2d', '955a934f-4e24-4780-9563-7395ddeb09eb', '6f1a563d-ce9d-432d-8b88-ad3bae7a68ca', '05385112-c291-4530-ad43-44da2cf8e253'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a04ba1c2-0fdc-4624-b951-ce508d69b4d1 tempest-GroupSnapshotsV319Test-1220851927 None] group_snapshot 9234afbd-f39e-4842-ac6d-10c4de420029: deleted successfully Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Acquiring lock "cinder-quobyte-8b89fa1b-a22c-4f10-83cc-dcb80708b688" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "cinder-quobyte-8b89fa1b-a22c-4f10-83cc-dcb80708b688" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b08a8-6271-4c80-baeb-e2b22db20e7d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:53 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 Nov 05 17:46:53 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:53 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688" returned: 0 in 0.467s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:53 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688 Nov 05 17:46:53 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:53 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8b89fa1b-a22c-4f10-83cc-dcb80708b688" returned: 0 in 0.325s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "cinder-quobyte-8b89fa1b-a22c-4f10-83cc-dcb80708b688" released by "delete_volume" :: held 0.888s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Created reservations ['6cf5fdf2-c87e-489f-8cbf-2043fa91d64d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:54 devstack cinder-volume[87126]: WARNING cinder.quota [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-596048071 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-596048071, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Created reservations ['adda976a-3310-4d20-9146-ae04433ca1d8', '863aa8a9-af0d-4141-95f8-04247d769722', '5966d9fc-0770-4fb7-8666-ffad17fbd324', '26b69f4b-c33e-40fb-86f1-83d79a0e81d8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:46:54 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:46:54 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:46:54 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:46:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:46:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e0eb0dc4-d5d9-4312-b188-19d939cfa2c5 tempest-GroupSnapshotsV319Test-1220851927 None] Delete group completed successfully. Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Flow 'volume_create_manager' (23fa3b93-f6ed-4c30-ba6e-f91213ae2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab056883-14b5-4156-ae50-806057259601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab056883-14b5-4156-ae50-806057259601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2101726877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7c451c-f678-4bfb-b2d4-8b9371d39e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd77cfaafd747cb9deda0f4fb7d1d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:01Z,use_quota=True,user_id='f63775885bfd4459b72a3686a083b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f03cb56f-dc3b-4994-b347-8960603db332),volume_type_id=f03cb56f-dc3b-4994-b347-8960603db332)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984a4423-60bf-4361-9977-7bedbfb34c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984a4423-60bf-4361-9977-7bedbfb34c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53a6e65-5b30-4476-bf6e-e67e1c5028b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53a6e65-5b30-4476-bf6e-e67e1c5028b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7c451c-f678-4bfb-b2d4-8b9371d39e43', 'volume_name': 'volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e9934b-9965-469d-ad14-7fa680631de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e9934b-9965-469d-ad14-7fa680631de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bac6846-a8d0-403a-ba74-e4c5153b276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:00 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Volume 3f7c451c-f678-4bfb-b2d4-8b9371d39e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43', 'volume_size': 1} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2101726877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7c451c-f678-4bfb-b2d4-8b9371d39e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd77cfaafd747cb9deda0f4fb7d1d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:01Z,use_quota=True,user_id='f63775885bfd4459b72a3686a083b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f03cb56f-dc3b-4994-b347-8960603db332),volume_type_id=f03cb56f-dc3b-4994-b347-8960603db332)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Creating volume 3f7c451c-f678-4bfb-b2d4-8b9371d39e43 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:00 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:00 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 1073741824 Nov 05 17:47:00 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7b740075-dfbb-479c-a803-30be89572bbb req-f977bad6-5f8c-4e4c-abeb-dfcfb1e9bf62 tempest-TestShelveInstance-1266827594 None] Terminate volume connection completed successfully. Nov 05 17:47:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-7b740075-dfbb-479c-a803-30be89572bbb req-f977bad6-5f8c-4e4c-abeb-dfcfb1e9bf62 tempest-TestShelveInstance-1266827594 None] Deleting attachment 241c6f5a-a5b2-4509-8c99-1fe44acede0c. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Acquiring lock "cinder-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Lock "cinder-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Acquiring lock "cinder-quobyte-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Lock "cinder-quobyte-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[59429289-26da-451e-a588-4047518e00c8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:01 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb Nov 05 17:47:01 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:01 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 1073741824" returned: 0 in 0.738s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:01 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 Nov 05 17:47:01 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:02 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb" returned: 0 in 0.614s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:02 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb Nov 05 17:47:02 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:02 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43" returned: 0 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bac6846-a8d0-403a-ba74-e4c5153b276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc4a73c-dda8-463e-b516-17121a528e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Volume volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 (3f7c451c-f678-4bfb-b2d4-8b9371d39e43): created successfully Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc4a73c-dda8-463e-b516-17121a528e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Flow 'volume_create_manager' (23fa3b93-f6ed-4c30-ba6e-f91213ae2261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ecc36297-bada-4f99-95a2-814bf006f454 tempest-VolumeTypesAccessTest-1981352775 None] Created volume successfully. Nov 05 17:47:02 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Lock "cinder-quobyte-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb" released by "delete_volume" :: held 1.033s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.quota [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Created reservations ['e0c96a4d-e98b-46f5-811f-81227bdc9f4d', '51fce679-c7ed-4738-90a6-293cfffedeb3', '0f644e24-09b6-4e04-9309-4f48d01005e9', '1f3379c5-2db4-4706-8ebc-7e24735e5744'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:02 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:02 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Acquiring lock "cinder-3f7c451c-f678-4bfb-b2d4-8b9371d39e43-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:02 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.manager [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Deleted volume successfully. Nov 05 17:47:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Lock "cinder-3f7c451c-f678-4bfb-b2d4-8b9371d39e43-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-7b740075-dfbb-479c-a803-30be89572bbb req-16c6fa0f-e8b1-49c1-8b45-36c07af6488a tempest-TestShelveInstance-1266827594 None] Lock "cinder-8e5ebfd6-a3a7-4967-b7d6-be478bb92afb-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Acquiring lock "cinder-quobyte-3f7c451c-f678-4bfb-b2d4-8b9371d39e43" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Lock "cinder-quobyte-3f7c451c-f678-4bfb-b2d4-8b9371d39e43" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eef4c7-bf65-40df-aa52-a6a665cea5a9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:03 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 Nov 05 17:47:03 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:03 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43" returned: 0 in 0.634s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:03 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43 Nov 05 17:47:03 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:04 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f7c451c-f678-4bfb-b2d4-8b9371d39e43" returned: 0 in 0.550s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Lock "cinder-quobyte-3f7c451c-f678-4bfb-b2d4-8b9371d39e43" released by "delete_volume" :: held 1.247s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:04 devstack cinder-volume[87126]: WARNING cinder.quota [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1209849786 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1209849786, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:47:04 devstack cinder-volume[87126]: WARNING cinder.quota [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1209849786 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1209849786, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Created reservations ['8f5c6acf-18cb-4690-ab62-2974e9dca386', '0f93d791-a8e8-4027-91ff-b288c8dff088', 'b6f95657-4d7a-4179-bbee-2a7674b57c09', 'effffe80-d0a6-4ee3-9b21-6c8dfd66f55c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:04 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:04 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:05 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:05 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Deleted volume successfully. Nov 05 17:47:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-520fdbd0-f80a-400c-8a81-1fd441cd6d09 tempest-VolumeTypesAccessTest-1981352775 None] Lock "cinder-3f7c451c-f678-4bfb-b2d4-8b9371d39e43-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:47:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:13 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:13 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:14 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:47:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:47:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:47:14 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=47,cinder:UPDATE=60,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:47:15 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=60,cinder:UPDATE=60,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Flow 'volume_create_manager' (fcace372-090e-46dc-922b-87d8e3850876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d883053-5079-43bf-bdd1-ed12fc9fb8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d883053-5079-43bf-bdd1-ed12fc9fb8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2125175034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681403d1-cabb-4a4d-a82c-19d5e154ac93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707731c01ee14941832ee983f434392c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:17Z,use_quota=True,user_id='1ba75054e0d14a6fa6f787b4e0bfaa77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455e24e-d2cd-4abb-993f-399fa627b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455e24e-d2cd-4abb-993f-399fa627b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c634c51f-f056-477c-8870-afdcf604978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c634c51f-f056-477c-8870-afdcf604978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681403d1-cabb-4a4d-a82c-19d5e154ac93', 'volume_name': 'volume-681403d1-cabb-4a4d-a82c-19d5e154ac93', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe60f8a-5218-4c04-8419-305ae077c0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe60f8a-5218-4c04-8419-305ae077c0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61d667e-9531-4e27-8cdf-3245768fbb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Volume 681403d1-cabb-4a4d-a82c-19d5e154ac93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681403d1-cabb-4a4d-a82c-19d5e154ac93', 'volume_size': 1} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2125175034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681403d1-cabb-4a4d-a82c-19d5e154ac93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707731c01ee14941832ee983f434392c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:17Z,use_quota=True,user_id='1ba75054e0d14a6fa6f787b4e0bfaa77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Creating volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:17 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 1073741824 Nov 05 17:47:17 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Flow 'volume_create_manager' (e5629b62-4e46-4832-9d28-eaf33353de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675b34d7-d68f-4878-82a9-f1bdbff107ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:18 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 1073741824" returned: 0 in 0.697s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675b34d7-d68f-4878-82a9-f1bdbff107ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2115118602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a72b9b3-87df-4966-879d-e75d08bc8cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dfa3de6055449386578936f66765e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:18Z,use_quota=True,user_id='00a97210820648bf995eae26931a53de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b338cdf7-4122-43cb-84d3-bb3373c03067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b338cdf7-4122-43cb-84d3-bb3373c03067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0277b524-9463-4a8d-a39c-b39171c435b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:18 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 Nov 05 17:47:18 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0277b524-9463-4a8d-a39c-b39171c435b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a72b9b3-87df-4966-879d-e75d08bc8cd6', 'volume_name': 'volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46400ca9-286a-4720-8b15-575854405b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46400ca9-286a-4720-8b15-575854405b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75205b43-bfdd-4c45-87ae-4506cb16e234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Volume 3a72b9b3-87df-4966-879d-e75d08bc8cd6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Trying to clone 3a72b9b3-87df-4966-879d-e75d08bc8cd6 from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:47:18 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61d667e-9531-4e27-8cdf-3245768fbb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681403d1-cabb-4a4d-a82c-19d5e154ac93', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8414f256-10c8-4d40-957a-b107d29b1ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Volume volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 (681403d1-cabb-4a4d-a82c-19d5e154ac93): created successfully Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8414f256-10c8-4d40-957a-b107d29b1ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Flow 'volume_create_manager' (fcace372-090e-46dc-922b-87d8e3850876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-feb13402-4e9a-4b11-aef4-cc7505e06698 tempest-SnapshotsActionsTest-765743355 None] Created volume successfully. Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:47:18 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Image download 20.69 MB at 20.69 MB/s Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[28215467-e5ad-4404-8ddc-d6e734fb3e31]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:19 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD Nov 05 17:47:19 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:19 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a is fetched for user 00a97210820648bf995eae26931a53de. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[02206425-814f-40d6-a4cc-ce55b59e254d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:19 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD Nov 05 17:47:19 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Creating offline snapshot 266f524b-9c02-403b-8fe3-584d86246d16 of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbe8bb0-67e5-4a26-8d2e-04ce3da51f4d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:19 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:19 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 Nov 05 17:47:19 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:20 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:20 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 1G Nov 05 17:47:20 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:20 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 1G" returned: 0 in 0.446s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:20 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:20 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:20 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.301s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:20 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 is being set with open permissions: ugo+rw Nov 05 17:47:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:20 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:20 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:21 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:21 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.info Nov 05 17:47:21 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:21 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.info" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:21 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.info is being set with open permissions: ugo+rw Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:21 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.info Nov 05 17:47:21 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:21 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.info" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2115118602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a72b9b3-87df-4966-879d-e75d08bc8cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dfa3de6055449386578936f66765e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:18Z,use_quota=True,user_id='00a97210820648bf995eae26931a53de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Creating volume 3a72b9b3-87df-4966-879d-e75d08bc8cd6 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:21 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 1073741824 Nov 05 17:47:21 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-565c1930-5d2d-4295-a2c2-5cabfd1ec02e tempest-SnapshotsActionsTest-765743355 None] Create snapshot completed successfully Nov 05 17:47:22 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 1073741824" returned: 0 in 0.485s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:22 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 Nov 05 17:47:22 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (8fca6472-6360-4251-bbdb-351bdf7c046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70973e0b-05d4-49b3-9eaf-8614f8daab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70973e0b-05d4-49b3-9eaf-8614f8daab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647055591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74121d09-0e49-40f9-81bb-c8478a5746ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:22Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828fcf38-d138-4bcd-8078-0f316c8ecf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828fcf38-d138-4bcd-8078-0f316c8ecf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941ad917-8971-422d-b803-83515caa8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941ad917-8971-422d-b803-83515caa8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74121d09-0e49-40f9-81bb-c8478a5746ec', 'volume_name': 'volume-74121d09-0e49-40f9-81bb-c8478a5746ec', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb4a1b1-0325-467a-943c-0eb6ec5e51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb4a1b1-0325-467a-943c-0eb6ec5e51f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85882c6-346e-4fd6-b22d-6f2b263c9208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Volume 74121d09-0e49-40f9-81bb-c8478a5746ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74121d09-0e49-40f9-81bb-c8478a5746ec', 'volume_size': 1} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:22 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647055591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74121d09-0e49-40f9-81bb-c8478a5746ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:22Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Creating volume 74121d09-0e49-40f9-81bb-c8478a5746ec {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:22 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:22 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec 1073741824 Nov 05 17:47:22 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Attempting download of 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 3a72b9b3-87df-4966-879d-e75d08bc8cd6. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23bd62c-1ecb-45ad-a564-88e35c97625c]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a__i742izj {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (e596d198-00be-4e0c-8f28-89b146c2143d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f99358-70f8-47f9-98ba-3c5867709f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f99358-70f8-47f9-98ba-3c5867709f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206058199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0440d2ab-6792-400d-90f8-523268ee0565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:23Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8e11fe-3f4f-4b38-aa89-62084b731c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8e11fe-3f4f-4b38-aa89-62084b731c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d381f86-2edb-43c5-a23e-659ee9f6c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d381f86-2edb-43c5-a23e-659ee9f6c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0440d2ab-6792-400d-90f8-523268ee0565', 'volume_name': 'volume-0440d2ab-6792-400d-90f8-523268ee0565', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9e4e48-1afb-43cf-98b0-5faa9a73bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9e4e48-1afb-43cf-98b0-5faa9a73bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a9a56c-2c8b-4d7b-b6ca-38d75ea14526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Volume 0440d2ab-6792-400d-90f8-523268ee0565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0440d2ab-6792-400d-90f8-523268ee0565', 'volume_size': 1} Nov 05 17:47:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:22 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a__i742izj Nov 05 17:47:22 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (43051868-5e0c-4e9d-92b7-a86ba59f47bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ed4e4d-58e2-46a5-bf94-90d0aff99f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ed4e4d-58e2-46a5-bf94-90d0aff99f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188170662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d66139-92e0-4730-a4c2-6183860add71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:23Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dece676-3843-4b63-8fbe-6ba8269468b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dece676-3843-4b63-8fbe-6ba8269468b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fb8836-7db7-42d8-b69d-7e20d76c6059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fb8836-7db7-42d8-b69d-7e20d76c6059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d66139-92e0-4730-a4c2-6183860add71', 'volume_name': 'volume-78d66139-92e0-4730-a4c2-6183860add71', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd48364-1ac7-4843-83f6-df6acb80cffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd48364-1ac7-4843-83f6-df6acb80cffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4b3c93-6bf1-4de1-9f82-ff3e2b516f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Volume 78d66139-92e0-4730-a4c2-6183860add71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d66139-92e0-4730-a4c2-6183860add71', 'volume_size': 1} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a__i742izj" returned: 0 in 0.569s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec 1073741824" returned: 0 in 0.699s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a__i742izj {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:23 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec Nov 05 17:47:23 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:23 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a__i742izj Nov 05 17:47:23 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:23 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:23 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206058199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0440d2ab-6792-400d-90f8-523268ee0565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:23Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Creating volume 0440d2ab-6792-400d-90f8-523268ee0565 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:23 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a__i742izj" returned: 1 in 0.453s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801ade9d-3bc5-40a6-b715-627da3a7cb0a__i742izj' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1793642-1232-4dbf-a751-a5cf0007abfc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:23 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 1073741824 Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:23 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85882c6-346e-4fd6-b22d-6f2b263c9208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74121d09-0e49-40f9-81bb-c8478a5746ec', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e074381-8b43-43e1-9a18-0b92b75506b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (3411340c-7d70-453d-876d-493811351e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb81b49-ad64-40eb-a9ed-81450ec7441e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Volume volume-74121d09-0e49-40f9-81bb-c8478a5746ec (74121d09-0e49-40f9-81bb-c8478a5746ec): created successfully Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e074381-8b43-43e1-9a18-0b92b75506b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (8fca6472-6360-4251-bbdb-351bdf7c046f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb81b49-ad64-40eb-a9ed-81450ec7441e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847664857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f779690-0424-4096-8ba8-9df1272f22ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:24Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63904266-8144-4cd3-8dde-ec4effbfe69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63904266-8144-4cd3-8dde-ec4effbfe69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a91a2e-613f-41c6-a735-121e9dd0dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a91a2e-613f-41c6-a735-121e9dd0dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f779690-0424-4096-8ba8-9df1272f22ab', 'volume_name': 'volume-3f779690-0424-4096-8ba8-9df1272f22ab', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD Nov 05 17:47:23 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45234c76-35d2-4b45-8ff0-80bd00ad34a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45234c76-35d2-4b45-8ff0-80bd00ad34a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb38dd6-6a65-46f0-b30d-974c452f2c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Volume 3f779690-0424-4096-8ba8-9df1272f22ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f779690-0424-4096-8ba8-9df1272f22ab', 'volume_size': 1} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b9b01747-f3be-40e9-97e3-bb8ca7c6123a tempest-CreateVolumesFromImageTest-949712474 None] Created volume successfully. Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:24 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (0bcf4a92-c798-45df-b0b0-44fdcfe2003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234680d0-34ef-4779-a3e8-1e403884582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] 801ade9d-3bc5-40a6-b715-627da3a7cb0a was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:24 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:24 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 Nov 05 17:47:24 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234680d0-34ef-4779-a3e8-1e403884582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438611216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7990fa6c-b4f3-4924-bce5-168936bfac6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:24Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6159d7-dd05-445a-aee1-bbf53ac77088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6159d7-dd05-445a-aee1-bbf53ac77088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ce5ec4-3df9-4d3b-802a-8afa04f06c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ce5ec4-3df9-4d3b-802a-8afa04f06c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7990fa6c-b4f3-4924-bce5-168936bfac6d', 'volume_name': 'volume-7990fa6c-b4f3-4924-bce5-168936bfac6d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39cba74-faea-486f-9f07-fe324143b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39cba74-faea-486f-9f07-fe324143b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03bb9f0-4b99-4f51-87a6-2db56e6b1c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Volume 7990fa6c-b4f3-4924-bce5-168936bfac6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7990fa6c-b4f3-4924-bce5-168936bfac6d', 'volume_size': 1} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 1073741824" returned: 0 in 0.641s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:24 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 Nov 05 17:47:24 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:24 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188170662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d66139-92e0-4730-a4c2-6183860add71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:23Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Creating volume 78d66139-92e0-4730-a4c2-6183860add71 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:24 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a9a56c-2c8b-4d7b-b6ca-38d75ea14526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0440d2ab-6792-400d-90f8-523268ee0565', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:24 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 1073741824 Nov 05 17:47:24 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e2b0e7-d2e6-4c02-8e2d-60b6424822ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Volume volume-0440d2ab-6792-400d-90f8-523268ee0565 (0440d2ab-6792-400d-90f8-523268ee0565): created successfully Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e2b0e7-d2e6-4c02-8e2d-60b6424822ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (e596d198-00be-4e0c-8f28-89b146c2143d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-130185d7-15d6-41f8-9fb1-ab40883e986d tempest-CreateVolumesFromImageTest-949712474 None] Created volume successfully. Nov 05 17:47:25 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 1073741824" returned: 0 in 0.623s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:25 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 Nov 05 17:47:25 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:25 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847664857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f779690-0424-4096-8ba8-9df1272f22ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:24Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Creating volume 3f779690-0424-4096-8ba8-9df1272f22ab {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:25 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:25 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab 1073741824 Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4b3c93-6bf1-4de1-9f82-ff3e2b516f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d66139-92e0-4730-a4c2-6183860add71', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:25 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a2757e-54b3-46a0-9e2f-06f9eeb7b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Volume volume-78d66139-92e0-4730-a4c2-6183860add71 (78d66139-92e0-4730-a4c2-6183860add71): created successfully Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a2757e-54b3-46a0-9e2f-06f9eeb7b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (43051868-5e0c-4e9d-92b7-a86ba59f47bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-74ff4de2-ee36-443e-9cb7-f5c7a7fc26a7 tempest-CreateVolumesFromImageTest-949712474 None] Created volume successfully. Nov 05 17:47:26 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab 1073741824" returned: 0 in 0.602s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:26 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab Nov 05 17:47:26 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:26 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6" returned: 0 in 2.210s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_801ade9d-3bc5-40a6-b715-627da3a7cb0a_azwy4qjvdevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:47:26 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Converted 112.00 MB image at 50.64 MB/s Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:26 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 1G Nov 05 17:47:26 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:26 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.681s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb38dd6-6a65-46f0-b30d-974c452f2c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f779690-0424-4096-8ba8-9df1272f22ab', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c85a62-0fcb-4f0d-a1a5-b4f9ac3e6ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Creating offline snapshot e3868a0a-e40f-4140-b069-d4e8e44dbc21 of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:47:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Volume volume-3f779690-0424-4096-8ba8-9df1272f22ab (3f779690-0424-4096-8ba8-9df1272f22ab): created successfully Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c85a62-0fcb-4f0d-a1a5-b4f9ac3e6ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (3411340c-7d70-453d-876d-493811351e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[580adca7-cd0c-4e9b-b4cf-b569f625c077]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-51d3e8c1-c3fe-4491-b361-86af3635fce1 tempest-CreateVolumesFromImageTest-949712474 None] Created volume successfully. Nov 05 17:47:26 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:26 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:26 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 1G" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Downloaded image 801ade9d-3bc5-40a6-b715-627da3a7cb0a ((None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}])) to volume 3a72b9b3-87df-4966-879d-e75d08bc8cd6 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Temporary image 801ade9d-3bc5-40a6-b715-627da3a7cb0a for user 00a97210820648bf995eae26931a53de is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Marking volume 3a72b9b3-87df-4966-879d-e75d08bc8cd6 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Copying metadata from image 801ade9d-3bc5-40a6-b715-627da3a7cb0a to 3a72b9b3-87df-4966-879d-e75d08bc8cd6. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Creating volume glance metadata for volume 3a72b9b3-87df-4966-879d-e75d08bc8cd6 backed by image 801ade9d-3bc5-40a6-b715-627da3a7cb0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75205b43-bfdd-4c45-87ae-4506cb16e234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6', 'volume_size': 1, 'image_id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '478782f6ec794bf7b7ec845a99197add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '801ade9d-3bc5-40a6-b715-627da3a7cb0a', 'created_at': datetime.datetime(2026, 11, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801ade9d-3bc5-40a6-b715-627da3a7cb0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc523a9f-4ff0-4737-b7bf-9d047a94b6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Volume volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 (3a72b9b3-87df-4966-879d-e75d08bc8cd6): created successfully Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc523a9f-4ff0-4737-b7bf-9d047a94b6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Flow 'volume_create_manager' (e5629b62-4e46-4832-9d28-eaf33353de1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4a7fd3d0-bf53-4298-b17e-338550d84670 tempest-VolumesImageMetadata-19143012 None] Created volume successfully. Nov 05 17:47:27 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:27 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 1G Nov 05 17:47:27 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:27 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 1G" returned: 0 in 0.408s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:27 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 Nov 05 17:47:27 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:27 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:27 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 is being set with open permissions: ugo+rw Nov 05 17:47:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:27 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 Nov 05 17:47:27 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:28 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.492s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.769s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438611216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7990fa6c-b4f3-4924-bce5-168936bfac6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0dd63b7630412783dfea8ceb430229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:24Z,use_quota=True,user_id='d23a42ecfee646a0b110cb4694e45803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Creating volume 7990fa6c-b4f3-4924-bce5-168936bfac6d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:28 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:28 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d 1073741824 Nov 05 17:47:28 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c74425f5-5508-4619-9028-ec8c7b8ee249 tempest-SnapshotsActionsTest-765743355 None] Create snapshot completed successfully Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Acquiring lock "cinder-3a72b9b3-87df-4966-879d-e75d08bc8cd6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Lock "cinder-3a72b9b3-87df-4966-879d-e75d08bc8cd6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Acquiring lock "cinder-quobyte-3a72b9b3-87df-4966-879d-e75d08bc8cd6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Lock "cinder-quobyte-3a72b9b3-87df-4966-879d-e75d08bc8cd6" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4574d49c-7a6b-458c-855c-465da0bce5bf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:28 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 Nov 05 17:47:28 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:28 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d 1073741824" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:28 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d Nov 05 17:47:28 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:28 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:28 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6 Nov 05 17:47:28 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:28 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03bb9f0-4b99-4f51-87a6-2db56e6b1c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7990fa6c-b4f3-4924-bce5-168936bfac6d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a84f97-ce38-4e7c-8fca-cf5f74638988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Volume volume-7990fa6c-b4f3-4924-bce5-168936bfac6d (7990fa6c-b4f3-4924-bce5-168936bfac6d): created successfully Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a84f97-ce38-4e7c-8fca-cf5f74638988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Flow 'volume_create_manager' (0bcf4a92-c798-45df-b0b0-44fdcfe2003e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d01aa482-694b-4301-a20d-a7f202486ed7 tempest-CreateVolumesFromImageTest-949712474 None] Created volume successfully. Nov 05 17:47:28 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3a72b9b3-87df-4966-879d-e75d08bc8cd6" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Lock "cinder-quobyte-3a72b9b3-87df-4966-879d-e75d08bc8cd6" released by "delete_volume" :: held 0.704s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Created reservations ['267e8b84-1100-4506-a1c7-c4582ff348bd', 'a995a479-ee5d-499a-9876-5dc1990582b2', 'e1108195-4218-4e59-9989-c8370aa0cb21', 'fd4f8114-7b9f-4c79-9cfc-375fd8e81244'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-e3868a0a-e40f-4140-b069-d4e8e44dbc21-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-e3868a0a-e40f-4140-b069-d4e8e44dbc21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-e3868a0a-e40f-4140-b069-d4e8e44dbc21" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-e3868a0a-e40f-4140-b069-d4e8e44dbc21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Deleting offline snapshot e3868a0a-e40f-4140-b069-d4e8e44dbc21 of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] snapshot_file for this snap is: volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb73bf-1002-4c76-94a4-741aaf31f424]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:29 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:29 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:29 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 Nov 05 17:47:29 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:29 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Deleted volume successfully. Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27a5e463-40d0-4564-a416-eb162b28bf36 tempest-VolumesImageMetadata-19143012 None] Lock "cinder-3a72b9b3-87df-4966-879d-e75d08bc8cd6-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:29 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e24c60-48eb-4643-82c0-40db1d92bb08]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:29 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:29 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-7990fa6c-b4f3-4924-bce5-168936bfac6d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-7990fa6c-b4f3-4924-bce5-168936bfac6d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-quobyte-7990fa6c-b4f3-4924-bce5-168936bfac6d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-7990fa6c-b4f3-4924-bce5-168936bfac6d" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fcc5a3-a18a-4faa-ab9f-3981ec3d11b9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:30 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.493s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:30 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d Nov 05 17:47:30 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:30 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 Nov 05 17:47:30 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:30 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:30 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d Nov 05 17:47:30 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:30 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21" returned: 0 in 0.557s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:30 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21 Nov 05 17:47:30 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Flow 'volume_create_manager' (d66c9e0f-d7d1-4291-82ab-df53f6682ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b1e424-93dd-4df2-ba30-bb0cf0ae0d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b1e424-93dd-4df2-ba30-bb0cf0ae0d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1189981402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e3bc0a-170f-4f2d-a5fc-4264886abfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdda3c78f2c424884e3ad6956554c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:31Z,use_quota=True,user_id='141f32ecbdc64a2daa27dde3abc1e9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e11216-3d88-4193-a5f8-8aa086cba887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e11216-3d88-4193-a5f8-8aa086cba887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c11232-c6dd-47a0-bf15-fcfc48c09193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c11232-c6dd-47a0-bf15-fcfc48c09193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e3bc0a-170f-4f2d-a5fc-4264886abfb5', 'volume_name': 'volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9979c1-355c-4781-b3f8-77fd50cc5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9979c1-355c-4781-b3f8-77fd50cc5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef09202-3564-46f1-85fd-9730240f28fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Volume 95e3bc0a-170f-4f2d-a5fc-4264886abfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5', 'volume_size': 1} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:30 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1189981402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e3bc0a-170f-4f2d-a5fc-4264886abfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdda3c78f2c424884e3ad6956554c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:31Z,use_quota=True,user_id='141f32ecbdc64a2daa27dde3abc1e9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Creating volume 95e3bc0a-170f-4f2d-a5fc-4264886abfb5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:30 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7990fa6c-b4f3-4924-bce5-168936bfac6d" returned: 0 in 0.472s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:30 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 1073741824 Nov 05 17:47:30 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-7990fa6c-b4f3-4924-bce5-168936bfac6d" released by "delete_volume" :: held 0.987s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Created reservations ['53a9349f-be06-425f-90cf-80e453d24e65', '3cf6697e-3b13-43ce-a4bd-0bea90b2f305', 'e5637373-d1ce-4674-9884-ca33605137b9', '0c42d440-f434-465c-8c6a-5f810f098492'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:31 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.e3868a0a-e40f-4140-b069-d4e8e44dbc21" returned: 0 in 0.332s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-e3868a0a-e40f-4140-b069-d4e8e44dbc21" released by "_delete_snapshot" :: held 1.931s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" released by "delete_snapshot" :: held 1.964s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:31 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:31 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Created reservations ['469daff6-00b4-494f-82a1-c85f08bcf749', '3e0578b1-9553-43c6-91da-31d6d7371493', '16214486-ffb3-4980-aa26-8ffba863b5d6', 'de319ea3-47bb-4a03-b724-74d0b9bbb77a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Delete snapshot completed successfully. Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db56e903-1b2e-4bb8-bab8-6b24c2d6d025 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-e3868a0a-e40f-4140-b069-d4e8e44dbc21-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:31 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Deleted volume successfully. Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae4952d7-bf7f-45fe-a422-b0f059b70d31 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-7990fa6c-b4f3-4924-bce5-168936bfac6d-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:31 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 1073741824" returned: 0 in 0.626s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:31 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 Nov 05 17:47:31 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:31 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef09202-3564-46f1-85fd-9730240f28fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd58a0ef-73ad-4f43-a9cb-9e0cee7d3ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Volume volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 (95e3bc0a-170f-4f2d-a5fc-4264886abfb5): created successfully Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd58a0ef-73ad-4f43-a9cb-9e0cee7d3ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Flow 'volume_create_manager' (d66c9e0f-d7d1-4291-82ab-df53f6682ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa3270a2-9944-4254-a9d2-d249d76eca1b tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Created volume successfully. Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-3f779690-0424-4096-8ba8-9df1272f22ab-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-3f779690-0424-4096-8ba8-9df1272f22ab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-quobyte-3f779690-0424-4096-8ba8-9df1272f22ab" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-3f779690-0424-4096-8ba8-9df1272f22ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfc414-7817-4b23-a0fd-ea235644abec]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:32 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab Nov 05 17:47:32 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Creating offline snapshot 69e8a7c7-8f63-4672-b964-315f0e031ca0 of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:47:32 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab" returned: 0 in 0.454s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7174a202-9f72-4e85-8ac2-6da415c2e794]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:32 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab Nov 05 17:47:32 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:32 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:32 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:32 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3f779690-0424-4096-8ba8-9df1272f22ab" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-3f779690-0424-4096-8ba8-9df1272f22ab" released by "delete_volume" :: held 0.830s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Created reservations ['945f748f-1bd9-4e7c-94a6-04a1c87c17e2', 'f80f2ac3-dcbc-487d-9210-fa6f1883a97a', 'da82a228-c37c-4d3c-b2a9-0fe269b30b50', 'acd542a9-1cb8-4fe7-b981-253c9b14c88f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:33 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.506s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:33 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:33 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:33 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 1G Nov 05 17:47:33 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:33 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.319s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Deleted volume successfully. Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-78d66139-92e0-4730-a4c2-6183860add71-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-78d66139-92e0-4730-a4c2-6183860add71-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3abe1333-9e44-4840-b453-16c7c9134292 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-3f779690-0424-4096-8ba8-9df1272f22ab-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-quobyte-78d66139-92e0-4730-a4c2-6183860add71" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-78d66139-92e0-4730-a4c2-6183860add71" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0082eb64-6d08-4345-8e2d-7bdd33e2b95b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:33 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 Nov 05 17:47:33 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:33 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 1G" returned: 0 in 0.652s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:33 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 Nov 05 17:47:33 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-869e4bbd-1d35-4df7-8152-e4595f193d89 req-38fa09b8-c701-43f7-9c96-a642f0155bc5 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Flow 'volume_create_manager' (6a330e97-e29f-4fc3-acd3-54da11b610a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c191507-a8c6-40b4-b4b7-9019fcfbdd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c191507-a8c6-40b4-b4b7-9019fcfbdd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1125081712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c99028e-4e62-4e1e-8951-f86cdbadaf67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9276a8008d8041d3b9e9b3c663486666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:34Z,use_quota=True,user_id='e2b9f05942c649fb835d468863e36d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:34 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eea7364-2c96-4c27-ba75-d0752c1fd3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eea7364-2c96-4c27-ba75-d0752c1fd3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9e0722-c282-4f80-b6fc-1f20933ee644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9e0722-c282-4f80-b6fc-1f20933ee644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c99028e-4e62-4e1e-8951-f86cdbadaf67', 'volume_name': 'volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57bd8a3-0315-4bf4-904f-5a6d99f7cf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57bd8a3-0315-4bf4-904f-5a6d99f7cf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d11f34-aabc-4a62-9d0a-974d14211405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Volume 7c99028e-4e62-4e1e-8951-f86cdbadaf67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67', 'volume_size': 1} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71" returned: 0 in 0.515s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:34 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71 Nov 05 17:47:34 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:34 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:34 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 is being set with open permissions: ugo+rw Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:34 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 Nov 05 17:47:34 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:34 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-78d66139-92e0-4730-a4c2-6183860add71" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-78d66139-92e0-4730-a4c2-6183860add71" released by "delete_volume" :: held 0.823s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:34 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-869e4bbd-1d35-4df7-8152-e4595f193d89 req-38fa09b8-c701-43f7-9c96-a642f0155bc5 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.481s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-869e4bbd-1d35-4df7-8152-e4595f193d89 req-38fa09b8-c701-43f7-9c96-a642f0155bc5 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1125081712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c99028e-4e62-4e1e-8951-f86cdbadaf67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9276a8008d8041d3b9e9b3c663486666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:34Z,use_quota=True,user_id='e2b9f05942c649fb835d468863e36d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Creating volume 7c99028e-4e62-4e1e-8951-f86cdbadaf67 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c8a1cecc-dcb1-438a-858b-2bee6f1ead75 tempest-SnapshotsActionsTest-765743355 None] Create snapshot completed successfully Nov 05 17:47:34 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 1073741824 Nov 05 17:47:34 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Created reservations ['bb3111ed-6e3d-4d8c-ba27-f48604dc4016', 'f6ece572-2d3e-414f-bd1d-228e51e7b3d0', 'd962a812-c883-40da-af45-8feed77d1459', '65b89b9c-b576-4355-8f70-c0d91e2c0657'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-869e4bbd-1d35-4df7-8152-e4595f193d89 req-38fa09b8-c701-43f7-9c96-a642f0155bc5 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebefc2c2-7a8f-44f9-be34-f3bff80d33ef', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:34 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:34 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-869e4bbd-1d35-4df7-8152-e4595f193d89 req-38fa09b8-c701-43f7-9c96-a642f0155bc5 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] attachment_update completed successfully. Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-0440d2ab-6792-400d-90f8-523268ee0565-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-0440d2ab-6792-400d-90f8-523268ee0565-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-quobyte-0440d2ab-6792-400d-90f8-523268ee0565" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-0440d2ab-6792-400d-90f8-523268ee0565" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:35 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c44e4b-a3a5-44dc-9b49-d202b4b35891]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-69e8a7c7-8f63-4672-b964-315f0e031ca0-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Deleted volume successfully. Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-69e8a7c7-8f63-4672-b964-315f0e031ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f486945d-1d72-45fe-bfb5-59435e88dd07 tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-78d66139-92e0-4730-a4c2-6183860add71-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-69e8a7c7-8f63-4672-b964-315f0e031ca0" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-69e8a7c7-8f63-4672-b964-315f0e031ca0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Deleting offline snapshot 69e8a7c7-8f63-4672-b964-315f0e031ca0 of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:47:35 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] snapshot_file for this snap is: volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 1073741824" returned: 0 in 0.683s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e7834-4bee-47b0-b25e-2a616e6ef505]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:35 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 Nov 05 17:47:35 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:35 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 Nov 05 17:47:35 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:35 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 Nov 05 17:47:35 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:35 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:35 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565" returned: 0 in 0.517s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d11f34-aabc-4a62-9d0a-974d14211405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:35 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565 Nov 05 17:47:35 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f000c66-92df-4451-a544-481a24752931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Volume volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 (7c99028e-4e62-4e1e-8951-f86cdbadaf67): created successfully Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f000c66-92df-4451-a544-481a24752931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Flow 'volume_create_manager' (6a330e97-e29f-4fc3-acd3-54da11b610a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c541afe7-89c1-4350-8d8f-3a9ff00ffda3 tempest-VolumesMetadataTest-1718116279 None] Created volume successfully. Nov 05 17:47:35 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0" returned: 0 in 0.531s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b393c-d546-4d99-a0c9-8809cc8b12b3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:36 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:36 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:36 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0440d2ab-6792-400d-90f8-523268ee0565" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-0440d2ab-6792-400d-90f8-523268ee0565" released by "delete_volume" :: held 0.985s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Created reservations ['b533bf29-0f2c-4c7b-a1ca-d25d38c5e652', '455a7d5c-c89a-4ca8-aa5b-144612ee5aae', '32f40588-1bb0-450e-ac2d-2be4594faf21', '16984197-782d-43ed-bf45-128979bc3589'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:36 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:36 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:36 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.473s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:36 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 Nov 05 17:47:36 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:36 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Deleted volume successfully. Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f3837927-6ef1-4881-a1c3-ef4d2f64c4ee tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-0440d2ab-6792-400d-90f8-523268ee0565-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:36 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0" returned: 0 in 0.539s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:36 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0 Nov 05 17:47:36 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:37 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.69e8a7c7-8f63-4672-b964-315f0e031ca0" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-69e8a7c7-8f63-4672-b964-315f0e031ca0" released by "_delete_snapshot" :: held 2.002s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" released by "delete_snapshot" :: held 2.034s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Acquiring lock "cinder-7c99028e-4e62-4e1e-8951-f86cdbadaf67-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-74121d09-0e49-40f9-81bb-c8478a5746ec-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Lock "cinder-7c99028e-4e62-4e1e-8951-f86cdbadaf67-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-74121d09-0e49-40f9-81bb-c8478a5746ec-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Acquiring lock "cinder-quobyte-7c99028e-4e62-4e1e-8951-f86cdbadaf67" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "cinder-quobyte-74121d09-0e49-40f9-81bb-c8478a5746ec" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Created reservations ['3136589f-296b-4523-a57d-fd97ab7c97f3', '85c68d43-be20-4721-b432-8e51e255c3b4', '67bfb34e-e3a3-44ff-b40a-4e3452a5534b', 'a2f8760d-b219-4217-b88a-ff8db5ebb7c2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Lock "cinder-quobyte-7c99028e-4e62-4e1e-8951-f86cdbadaf67" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-74121d09-0e49-40f9-81bb-c8478a5746ec" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be4386-057b-40e0-9a44-27fbad964fe9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2cf377-6f87-4cd9-9fa2-b497a8aff2ba]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Delete snapshot completed successfully. Nov 05 17:47:37 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 Nov 05 17:47:37 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2183b41e-8a43-422e-af95-5707f31dc19f tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-69e8a7c7-8f63-4672-b964-315f0e031ca0-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:37 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec Nov 05 17:47:37 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-c9a9dc49-84fd-4f61-a389-2a96a45c9029 req-2efc12a8-27a4-43ee-9cdc-b98ceca11455 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Terminate volume connection completed successfully. Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-c9a9dc49-84fd-4f61-a389-2a96a45c9029 req-2efc12a8-27a4-43ee-9cdc-b98ceca11455 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Deleting attachment ebefc2c2-7a8f-44f9-be34-f3bff80d33ef. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:47:37 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67" returned: 0 in 0.410s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:37 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:37 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67 Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:37 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:37 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec Nov 05 17:47:37 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:38 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c99028e-4e62-4e1e-8951-f86cdbadaf67" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:38 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-74121d09-0e49-40f9-81bb-c8478a5746ec" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Lock "cinder-quobyte-7c99028e-4e62-4e1e-8951-f86cdbadaf67" released by "delete_volume" :: held 0.775s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-quobyte-74121d09-0e49-40f9-81bb-c8478a5746ec" released by "delete_volume" :: held 0.770s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Created reservations ['f7ebad20-86a1-4f88-8665-c487562aa40b', 'c8e495f6-1517-45e5-a2e5-711b20c51584', '4a41f342-aaa5-4886-bc41-75244608a496', '1a033360-41de-4727-a7af-ee2ea177a01f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Created reservations ['a80a45ea-7705-4f57-833a-29bebbad0caf', 'fcf873e1-fc8c-4a09-ab91-953c7c24db0f', '68f78fad-797d-480c-bd1f-7d3f3319883b', '2af8fe3a-d56e-4b67-8fc8-9b27fc558941'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:38 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:38 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:38 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:38 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:38 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Acquiring lock "cinder-95e3bc0a-170f-4f2d-a5fc-4264886abfb5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Deleted volume successfully. Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "cinder-95e3bc0a-170f-4f2d-a5fc-4264886abfb5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:38 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.371s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e6f16a28-cb7c-4173-9c53-392ae93c0622 tempest-VolumesMetadataTest-1718116279 None] Lock "cinder-7c99028e-4e62-4e1e-8951-f86cdbadaf67-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Deleted volume successfully. Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-25f2553c-5924-4397-a989-156e44e4851d tempest-CreateVolumesFromImageTest-949712474 None] Lock "cinder-74121d09-0e49-40f9-81bb-c8478a5746ec-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Acquiring lock "cinder-quobyte-95e3bc0a-170f-4f2d-a5fc-4264886abfb5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "cinder-quobyte-95e3bc0a-170f-4f2d-a5fc-4264886abfb5" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9137a5c8-1739-42bf-84eb-8072a3e4b07b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Creating offline snapshot 3dd2edf8-a054-4b33-adff-24386deed7df of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:47:39 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 Nov 05 17:47:39 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46e27b6-2904-473d-8cfb-bc208726deb9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:39 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:39 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:39 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5" returned: 0 in 0.429s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:39 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5 Nov 05 17:47:39 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:39 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:39 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df 1G Nov 05 17:47:39 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:39 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-95e3bc0a-170f-4f2d-a5fc-4264886abfb5" returned: 0 in 0.304s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "cinder-quobyte-95e3bc0a-170f-4f2d-a5fc-4264886abfb5" released by "delete_volume" :: held 0.798s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Created reservations ['664c2fd9-d8be-4569-9741-16dbd7c57e0b', '036b69b7-1631-401a-97f1-3b4eec778504', '416d17f2-dd03-430f-ac9f-e2ccef85f5c8', '8d4d122c-72f8-458b-9598-5bd3a2f812b3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:39 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:47:39 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:40 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:40 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:47:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Deleted volume successfully. Nov 05 17:47:40 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df 1G" returned: 0 in 0.692s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:40 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df Nov 05 17:47:40 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9b0eefdb-6e15-41bb-b81c-caea49efe966 tempest-TestServerVolumeAttachScenarioOldVersion-139719448 None] Lock "cinder-95e3bc0a-170f-4f2d-a5fc-4264886abfb5-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:40 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:40 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df is being set with open permissions: ugo+rw Nov 05 17:47:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:40 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df Nov 05 17:47:40 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:41 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df" returned: 0 in 0.458s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-30cb19a5-386b-4a56-9251-52fea6ccf71c tempest-SnapshotsActionsTest-765743355 None] Create snapshot completed successfully Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-3dd2edf8-a054-4b33-adff-24386deed7df-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-3dd2edf8-a054-4b33-adff-24386deed7df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-3dd2edf8-a054-4b33-adff-24386deed7df" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-3dd2edf8-a054-4b33-adff-24386deed7df" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Deleting offline snapshot 3dd2edf8-a054-4b33-adff-24386deed7df of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] snapshot_file for this snap is: volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a565e170-2656-4374-93a3-08f7836c8360]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:42 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df Nov 05 17:47:42 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:43 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df" returned: 0 in 0.482s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[78495450-ac87-4e0c-84ea-e7c1dc86c5ac]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:43 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:43 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:43 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:43 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df Nov 05 17:47:43 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:44 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df" returned: 0 in 0.534s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:44 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df Nov 05 17:47:44 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Flow 'volume_create_manager' (abd44f9e-0019-4e54-b26c-61e208bc4f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09eaa43d-92cc-4ab0-aa34-f16065bfe15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09eaa43d-92cc-4ab0-aa34-f16065bfe15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1231625801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f710420a-412d-42af-8aa6-eedb5142549d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0753d5f3fd74777a5509d0df93c723e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:44Z,use_quota=True,user_id='1808a1541180436c89649c2c0548e014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7c2c14-b461-40a5-a336-09cf85297c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:44 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7c2c14-b461-40a5-a336-09cf85297c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0a0f70-7b02-47c0-b5f2-7d1ce143faba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0a0f70-7b02-47c0-b5f2-7d1ce143faba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f710420a-412d-42af-8aa6-eedb5142549d', 'volume_name': 'volume-f710420a-412d-42af-8aa6-eedb5142549d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dc8413-e73f-4a7e-9022-a808c0596d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dc8413-e73f-4a7e-9022-a808c0596d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b449ca3c-78e8-451e-af4b-94db1a5c2690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Volume f710420a-412d-42af-8aa6-eedb5142549d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f710420a-412d-42af-8aa6-eedb5142549d', 'volume_size': 1} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1231625801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f710420a-412d-42af-8aa6-eedb5142549d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0753d5f3fd74777a5509d0df93c723e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:44Z,use_quota=True,user_id='1808a1541180436c89649c2c0548e014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Creating volume f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:47:44 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.3dd2edf8-a054-4b33-adff-24386deed7df" returned: 0 in 0.382s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:44 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d 1073741824 Nov 05 17:47:44 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-3dd2edf8-a054-4b33-adff-24386deed7df" released by "_delete_snapshot" :: held 2.084s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" released by "delete_snapshot" :: held 2.115s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Created reservations ['484e87dc-0dc0-40e6-b55e-921a93941135', '998bcd57-50d5-47af-bd85-c4d4daebf6e1', '7148a180-5ee9-4a30-828b-857e88fccfe1', '045c2abd-21ea-47e7-80f7-6104fb97039c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Delete snapshot completed successfully. Nov 05 17:47:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-26d51a03-f6e2-4e9d-a203-d08e5f105252 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-3dd2edf8-a054-4b33-adff-24386deed7df-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:45 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d 1073741824" returned: 0 in 0.651s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:45 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d Nov 05 17:47:45 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:45 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b449ca3c-78e8-451e-af4b-94db1a5c2690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f710420a-412d-42af-8aa6-eedb5142549d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6193dd-15ec-4f7e-902e-281fd9213ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Volume volume-f710420a-412d-42af-8aa6-eedb5142549d (f710420a-412d-42af-8aa6-eedb5142549d): created successfully Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6193dd-15ec-4f7e-902e-281fd9213ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Flow 'volume_create_manager' (abd44f9e-0019-4e54-b26c-61e208bc4f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a5bc0174-a0c8-4ea6-91da-4726ca5831fd tempest-VolumesCloneTest-1815054248 None] Created volume successfully. Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Creating offline snapshot ef5e3603-0716-43b0-9b97-46e3419c1e9c of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:47:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a2eee1-0feb-4b69-854f-cc8a282e5efb]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:46 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:46 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:46 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.481s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:46 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c 1G Nov 05 17:47:46 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Flow 'volume_create_manager' (720f697d-e672-4532-97c6-d39ec27142c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391fcb90-22c7-42a9-bac3-e828ddc94f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391fcb90-22c7-42a9-bac3-e828ddc94f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-375303486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddd120d-2d25-4f17-b9d9-69a64efd74bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0753d5f3fd74777a5509d0df93c723e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:47:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f710420a-412d-42af-8aa6-eedb5142549d,status='creating',terminated_at=None,updated_at=2026-11-05T16:47:47Z,use_quota=True,user_id='1808a1541180436c89649c2c0548e014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f009d464-8d06-46da-9ccf-205cb8e14343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f009d464-8d06-46da-9ccf-205cb8e14343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89a5a64-09c8-4540-bb97-9c46baafc31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89a5a64-09c8-4540-bb97-9c46baafc31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cddd120d-2d25-4f17-b9d9-69a64efd74bb', 'volume_name': 'volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb', 'volume_size': 2, 'source_volid': 'f710420a-412d-42af-8aa6-eedb5142549d', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:47 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145f86db-40bf-4941-a140-b698dd885662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145f86db-40bf-4941-a140-b698dd885662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9c1dcb-947e-40f0-ae85-b283e699dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:47:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Volume cddd120d-2d25-4f17-b9d9-69a64efd74bb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb', 'volume_size': 2, 'source_volid': 'f710420a-412d-42af-8aa6-eedb5142549d', 'source_volstatus': 'available'} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c 1G" returned: 0 in 0.730s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:47 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c Nov 05 17:47:47 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:47 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:47 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c is being set with open permissions: ugo+rw Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:47 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c Nov 05 17:47:47 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:47 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.753s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:48 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Cloning volume f710420a-412d-42af-8aa6-eedb5142549d to volume cddd120d-2d25-4f17-b9d9-69a64efd74bb Nov 05 17:47:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Creating offline snapshot a8eeae52-54fe-44e0-bc00-3a9159f4a81e of volume f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:47:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e07b1f7d-dbd5-4aec-bb7e-3cd56b2d7a19 tempest-SnapshotsActionsTest-765743355 None] Create snapshot completed successfully Nov 05 17:47:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f7146a-b825-4121-af28-f8cae28d096b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:48 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d Nov 05 17:47:48 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:48 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:48 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e 1G Nov 05 17:47:48 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:49 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e 1G" returned: 0 in 0.526s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f710420a-412d-42af-8aa6-eedb5142549d -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:49 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f710420a-412d-42af-8aa6-eedb5142549d -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e Nov 05 17:47:49 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-ef5e3603-0716-43b0-9b97-46e3419c1e9c-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-ef5e3603-0716-43b0-9b97-46e3419c1e9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Acquiring lock "cinder-quobyte-ef5e3603-0716-43b0-9b97-46e3419c1e9c" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-ef5e3603-0716-43b0-9b97-46e3419c1e9c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Deleting offline snapshot ef5e3603-0716-43b0-9b97-46e3419c1e9c of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] snapshot_file for this snap is: volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:47:49 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a5a87f-d3d4-4769-840d-f64ef3aa0839]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f710420a-412d-42af-8aa6-eedb5142549d -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e" returned: 0 in 0.460s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:49 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e is being set with open permissions: ugo+rw Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:49 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e Nov 05 17:47:49 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:49 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c Nov 05 17:47:49 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:49 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:49 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.info Nov 05 17:47:49 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:49 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c" returned: 0 in 0.510s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bbe364-ea48-46cd-bbbc-7c01171080b3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:50 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.info" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:50 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.info is being set with open permissions: ugo+rw Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:50 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.info Nov 05 17:47:50 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:50 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:50 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:50 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.info" returned: 0 in 0.390s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Acquiring lock "cinder-quobyte-cddd120d-2d25-4f17-b9d9-69a64efd74bb" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-cddd120d-2d25-4f17-b9d9-69a64efd74bb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] snapshot: a8eeae52-54fe-44e0-bc00-3a9159f4a81e, volume: cddd120d-2d25-4f17-b9d9-69a64efd74bb, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:47:50 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.635s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4a9c89-fcb5-4f4a-92a8-daa7d7101515]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:50 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c Nov 05 17:47:50 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:50 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e Nov 05 17:47:50 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:51 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:51 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f710420a-412d-42af-8aa6-eedb5142549d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c" returned: 0 in 0.524s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f640a-d72a-48b2-a631-fdae8b545a07]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:51 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c Nov 05 17:47:51 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:51 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d Nov 05 17:47:51 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:51 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.ef5e3603-0716-43b0-9b97-46e3419c1e9c" returned: 0 in 0.322s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-ef5e3603-0716-43b0-9b97-46e3419c1e9c" released by "_delete_snapshot" :: held 2.159s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" released by "delete_snapshot" :: held 2.190s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Created reservations ['b60a71bd-13bc-4aa9-9afd-95fc06951ad1', 'dc67c927-61c8-4c83-919d-2f31881d3b9f', '19e50f6d-3ed8-4d68-8a6f-4c61122c5ad0', '842bb53e-4b6d-45a0-bd9c-e1f779092c10'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:51 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d" returned: 0 in 0.451s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:51 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb Nov 05 17:47:51 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Delete snapshot completed successfully. Nov 05 17:47:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5087822e-8a9e-406a-a3fa-f73dca038f26 tempest-SnapshotsActionsTest-1438127462 None] Lock "cinder-ef5e3603-0716-43b0-9b97-46e3419c1e9c-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "cinder-266f524b-9c02-403b-8fe3-584d86246d16-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-266f524b-9c02-403b-8fe3-584d86246d16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "cinder-quobyte-266f524b-9c02-403b-8fe3-584d86246d16" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-quobyte-266f524b-9c02-403b-8fe3-584d86246d16" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Deleting offline snapshot 266f524b-9c02-403b-8fe3-584d86246d16 of volume 681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] snapshot_file for this snap is: volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc77ea80-4018-42cc-a90c-08bbd35ab03a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:54 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:54 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:55 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.988s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681403d1-cabb-4a4d-a82c-19d5e154ac93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:47:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dd56d0-9f62-4899-b786-8753f6a4cf6b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:55 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 Nov 05 17:47:55 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:56 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93" returned: 0 in 0.847s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:56 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:56 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:57 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.971s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:57 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16 Nov 05 17:47:57 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:47:57 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Nov 05 17:47:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93.266f524b-9c02-403b-8fe3-584d86246d16" returned: 0 in 0.633s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:47:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-quobyte-266f524b-9c02-403b-8fe3-584d86246d16" released by "_delete_snapshot" :: held 3.726s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" released by "delete_snapshot" :: held 3.781s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Created reservations ['64c96b28-3780-43af-a16b-0e44df1470ee', '7b7743d1-6f49-4005-abd6-f803da7ab296', '52e5284b-8088-46a2-8bb3-9dfda79a4945', '4df96c33-575f-425b-aa7b-79efb5ad4df4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:47:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Delete snapshot completed successfully. Nov 05 17:47:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8c5edb40-5d47-4e80-89c2-2ce611b18cdc tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-266f524b-9c02-403b-8fe3-584d86246d16-delete_snapshot" released by "delete_snapshot" :: held 4.107s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:47:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "cinder-681403d1-cabb-4a4d-a82c-19d5e154ac93-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-681403d1-cabb-4a4d-a82c-19d5e154ac93-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:47:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:47:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7ba30-4721-439d-8fa0-c1ff413c16cd]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:47:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:47:59 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 Nov 05 17:47:59 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:00 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93" returned: 0 in 0.930s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:00 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93 Nov 05 17:48:00 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:00 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb" returned: 0 in 8.781s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:48:00 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Converted 1024.00 MB image at 116.60 MB/s Nov 05 17:48:00 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb is being set with open permissions: ugo+rw Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:00 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb Nov 05 17:48:00 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:00 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-681403d1-cabb-4a4d-a82c-19d5e154ac93" returned: 0 in 0.582s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-quobyte-681403d1-cabb-4a4d-a82c-19d5e154ac93" released by "delete_volume" :: held 1.657s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (16c10162-7323-478b-89c6-44eb3012cb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232139f9-4ff9-423f-951f-129fa992d6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232139f9-4ff9-423f-951f-129fa992d6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325465693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1447a616-dcb5-4b7a-9551-24a19f4dd93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:01Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d745192-1f30-4c2c-8cb7-7fa36c006994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d745192-1f30-4c2c-8cb7-7fa36c006994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e60b4d-f9dd-4409-bc5f-924ae3f9dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e60b4d-f9dd-4409-bc5f-924ae3f9dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1447a616-dcb5-4b7a-9551-24a19f4dd93e', 'volume_name': 'volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e5047b-e3aa-42dc-ba4e-58e71693bcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e5047b-e3aa-42dc-ba4e-58e71693bcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c706d69a-cc6f-47f2-9a50-e53edc7c8bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:00 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Volume 1447a616-dcb5-4b7a-9551-24a19f4dd93e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e', 'volume_size': 1} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:00 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Created reservations ['630e0479-0fe3-4d07-aa5b-37c61c566226', '5712d880-e732-4299-bbbe-2539813a8b8a', '260f9f0d-ccd8-4090-af2b-f28f18f0b814', '62d49ef8-072c-4a12-8c50-d445af80f333'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-cddd120d-2d25-4f17-b9d9-69a64efd74bb" released by "_copy_volume_from_snapshot" :: held 10.194s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Acquiring lock "cinder-quobyte-a8eeae52-54fe-44e0-bc00-3a9159f4a81e" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-a8eeae52-54fe-44e0-bc00-3a9159f4a81e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Deleting offline snapshot a8eeae52-54fe-44e0-bc00-3a9159f4a81e of volume f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] snapshot_file for this snap is: volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac632ee9-e631-411f-ab83-138f33670cbb]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:00 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:00 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:01 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e Nov 05 17:48:01 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:01 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Deleted volume successfully. Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f50c1207-cdc8-4f1f-bfd6-d837799fcb53 tempest-SnapshotsActionsTest-765743355 None] Lock "cinder-681403d1-cabb-4a4d-a82c-19d5e154ac93-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:01 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e" returned: 0 in 0.408s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f710420a-412d-42af-8aa6-eedb5142549d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4221bd55-2c6f-4096-9373-ebd6f0c4531c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:01 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d Nov 05 17:48:01 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:01 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d" returned: 0 in 0.614s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:02 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e Nov 05 17:48:02 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:02 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:02 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e Nov 05 17:48:02 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:02 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d.a8eeae52-54fe-44e0-bc00-3a9159f4a81e" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-a8eeae52-54fe-44e0-bc00-3a9159f4a81e" released by "_delete_snapshot" :: held 1.821s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.706s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325465693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1447a616-dcb5-4b7a-9551-24a19f4dd93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:01Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Creating volume 1447a616-dcb5-4b7a-9551-24a19f4dd93e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:02 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e 1073741824 Nov 05 17:48:02 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9c1dcb-947e-40f0-ae85-b283e699dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb', 'volume_size': 2, 'source_volid': 'f710420a-412d-42af-8aa6-eedb5142549d', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8be154-cc16-411b-8dd5-7c3b5e26c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Volume volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb (cddd120d-2d25-4f17-b9d9-69a64efd74bb): created successfully Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8be154-cc16-411b-8dd5-7c3b5e26c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Flow 'volume_create_manager' (720f697d-e672-4532-97c6-d39ec27142c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e14b7af9-c0d1-488f-b0a5-83d07a283f16 tempest-VolumesCloneTest-1815054248 None] Created volume successfully. Nov 05 17:48:03 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e 1073741824" returned: 0 in 0.585s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:03 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e Nov 05 17:48:03 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:03 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c706d69a-cc6f-47f2-9a50-e53edc7c8bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecf3c8a-b505-454e-82c1-a3a59ab439cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Volume volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e (1447a616-dcb5-4b7a-9551-24a19f4dd93e): created successfully Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecf3c8a-b505-454e-82c1-a3a59ab439cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (16c10162-7323-478b-89c6-44eb3012cb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ba8bba98-c2c9-4687-94c8-646b1258d35f tempest-ProjectReaderTests-1311565892 None] Created volume successfully. Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-1447a616-dcb5-4b7a-9551-24a19f4dd93e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Lock "cinder-1447a616-dcb5-4b7a-9551-24a19f4dd93e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Acquiring lock "cinder-cddd120d-2d25-4f17-b9d9-69a64efd74bb-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Lock "cinder-cddd120d-2d25-4f17-b9d9-69a64efd74bb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-quobyte-1447a616-dcb5-4b7a-9551-24a19f4dd93e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-1447a616-dcb5-4b7a-9551-24a19f4dd93e" acquired by "delete_volume" :: waited 0.046s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[253d6562-7fb0-4b93-981c-856bdc5e3826]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Acquiring lock "cinder-quobyte-cddd120d-2d25-4f17-b9d9-69a64efd74bb" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-cddd120d-2d25-4f17-b9d9-69a64efd74bb" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4223754c-adba-4c53-969b-e0d4518be0f4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:04 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e Nov 05 17:48:04 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:04 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb Nov 05 17:48:04 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:05 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e" returned: 0 in 0.547s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:05 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e Nov 05 17:48:05 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:05 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb" returned: 0 in 0.511s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:05 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb Nov 05 17:48:05 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:05 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1447a616-dcb5-4b7a-9551-24a19f4dd93e" returned: 0 in 0.378s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-1447a616-dcb5-4b7a-9551-24a19f4dd93e" released by "delete_volume" :: held 1.022s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Created reservations ['0f150774-8a13-4afe-94b9-b6dd0226e991', '28079c02-1d8c-432e-991b-e7261c6d1587', 'e2aea1d2-6a21-48cc-a3aa-e883a09529df', '84515e1f-f98a-4656-93e0-4b1a5cefb257'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:05 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cddd120d-2d25-4f17-b9d9-69a64efd74bb" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-cddd120d-2d25-4f17-b9d9-69a64efd74bb" released by "delete_volume" :: held 1.023s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Created reservations ['59ae6f39-d9dc-47bc-a3c5-d873efeade75', '51f5348b-716b-453e-a886-f4c0c8706426', 'a9c3891a-580e-4760-8e84-d498f8314199', '4c7cb8fe-67dc-458f-a785-dba82a4e2133'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:05 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:05 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:05 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:05 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:06 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Deleted volume successfully. Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62f95fb4-39d3-4d2b-a3c4-0fc9f3fddebe tempest-ProjectReaderTests-1311565892 None] Lock "cinder-1447a616-dcb5-4b7a-9551-24a19f4dd93e-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:06 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Deleted volume successfully. Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8fd67457-2bfb-456e-ba70-749f1552d8ba tempest-VolumesCloneTest-1815054248 None] Lock "cinder-cddd120d-2d25-4f17-b9d9-69a64efd74bb-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Acquiring lock "cinder-f710420a-412d-42af-8aa6-eedb5142549d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Lock "cinder-f710420a-412d-42af-8aa6-eedb5142549d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Acquiring lock "cinder-quobyte-f710420a-412d-42af-8aa6-eedb5142549d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-f710420a-412d-42af-8aa6-eedb5142549d" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed4b98-b56a-4a8c-8928-e0e50e898527]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:07 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d Nov 05 17:48:07 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (86fd49cb-ea9d-4de2-8241-d9093db71edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25363a3b-f3a5-4330-ba57-923679554a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25363a3b-f3a5-4330-ba57-923679554a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293587709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2a7070-bed8-4c9c-8e5d-5a723cba26ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:07Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a37714c-020b-4e9f-990a-0054027b1871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a37714c-020b-4e9f-990a-0054027b1871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ae4ec8-edd1-493b-8881-e6f5b7f4b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ae4ec8-edd1-493b-8881-e6f5b7f4b088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2a7070-bed8-4c9c-8e5d-5a723cba26ed', 'volume_name': 'volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d3fd30-62d3-4516-a3e3-e1e5fc33c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d3fd30-62d3-4516-a3e3-e1e5fc33c441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5afee3-4171-446d-a1ba-68998d0265bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Volume 3b2a7070-bed8-4c9c-8e5d-5a723cba26ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed', 'volume_size': 1} Nov 05 17:48:07 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293587709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2a7070-bed8-4c9c-8e5d-5a723cba26ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:07Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Creating volume 3b2a7070-bed8-4c9c-8e5d-5a723cba26ed {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:07 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d" returned: 0 in 0.555s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:07 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed 1073741824 Nov 05 17:48:07 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:07 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d Nov 05 17:48:07 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:07 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f710420a-412d-42af-8aa6-eedb5142549d" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Lock "cinder-quobyte-f710420a-412d-42af-8aa6-eedb5142549d" released by "delete_volume" :: held 1.008s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Created reservations ['c13ef110-7b9b-4ce0-9ea6-c2d8f433e073', '216fed28-2ba8-451e-a7a3-b6bb68c4e351', '4228b2dd-cf44-425e-bbbb-00822e883137', '586fd87d-5779-45e7-9977-d47d43c12983'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:08 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed 1073741824" returned: 0 in 0.620s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:08 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:08 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:08 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed Nov 05 17:48:08 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:08 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Deleted volume successfully. Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-61e4723a-1409-4ef2-a23f-2f04f5cf103f tempest-VolumesCloneTest-1815054248 None] Lock "cinder-f710420a-412d-42af-8aa6-eedb5142549d-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:08 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5afee3-4171-446d-a1ba-68998d0265bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8e100a-336d-49bf-8bf0-3ca025ca90b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Volume volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed (3b2a7070-bed8-4c9c-8e5d-5a723cba26ed): created successfully Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8e100a-336d-49bf-8bf0-3ca025ca90b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (86fd49cb-ea9d-4de2-8241-d9093db71edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-01fdf245-9eb3-4004-a5f6-259c9519e701 tempest-ProjectReaderTests-1311565892 None] Created volume successfully. Nov 05 17:48:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Lock "cinder-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-quobyte-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff754544-74b5-4e58-a91c-d139110c4d5a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:09 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed Nov 05 17:48:09 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:10 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed" returned: 0 in 0.563s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:10 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed Nov 05 17:48:10 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:10 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed" returned: 0 in 0.290s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed" released by "delete_volume" :: held 0.949s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Created reservations ['3789f339-dd72-462a-b82b-f31bcf067bda', '214a4973-fa34-4981-a2f5-2ac0741a66a8', 'c16d617f-18d5-4d92-b182-e7a9a2797099', 'daae49c9-30f7-492c-a180-0789dde5d69f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:10 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:10 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:11 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:11 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Deleted volume successfully. Nov 05 17:48:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-859e77de-885b-4d77-8ea9-546eb6b4fe2e tempest-ProjectReaderTests-1311565892 None] Lock "cinder-3b2a7070-bed8-4c9c-8e5d-5a723cba26ed-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (4edfd023-6327-4f7b-8bca-a7b19bc5fe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9670d10-d778-4bb3-9102-99f9c21fd85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9670d10-d778-4bb3-9102-99f9c21fd85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576073789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a47195-773e-4e4a-8ee8-c1b498bc1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:13Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f0e376-ee1d-4c44-ab20-1fd2e63e8eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f0e376-ee1d-4c44-ab20-1fd2e63e8eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058b73ef-fc3f-4249-b03f-f54c3b6c02c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058b73ef-fc3f-4249-b03f-f54c3b6c02c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a47195-773e-4e4a-8ee8-c1b498bc1942', 'volume_name': 'volume-96a47195-773e-4e4a-8ee8-c1b498bc1942', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dedde1-388d-43b5-9591-4e4261573072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dedde1-388d-43b5-9591-4e4261573072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a4cb89-0b25-4584-b984-6392c2204b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Volume 96a47195-773e-4e4a-8ee8-c1b498bc1942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a47195-773e-4e4a-8ee8-c1b498bc1942', 'volume_size': 1} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576073789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a47195-773e-4e4a-8ee8-c1b498bc1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:13Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Creating volume 96a47195-773e-4e4a-8ee8-c1b498bc1942 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:12 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:12 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 1073741824 Nov 05 17:48:12 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:13 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 1073741824" returned: 0 in 0.630s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:13 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 Nov 05 17:48:13 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:13 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a4cb89-0b25-4584-b984-6392c2204b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a47195-773e-4e4a-8ee8-c1b498bc1942', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e1ebc-c984-4d0e-873e-9476733b3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Volume volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 (96a47195-773e-4e4a-8ee8-c1b498bc1942): created successfully Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e1ebc-c984-4d0e-873e-9476733b3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (4edfd023-6327-4f7b-8bca-a7b19bc5fe1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:13 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:13 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7ba1a438-b8e3-4a33-ab7f-c098feba3907 tempest-ProjectReaderTests-1311565892 None] Created volume successfully. Nov 05 17:48:14 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-96a47195-773e-4e4a-8ee8-c1b498bc1942-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Lock "cinder-96a47195-773e-4e4a-8ee8-c1b498bc1942-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=183,cinder:SELECT=137,cinder:INSERT=51,cinder:DELETE=16 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-quobyte-96a47195-773e-4e4a-8ee8-c1b498bc1942" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-96a47195-773e-4e4a-8ee8-c1b498bc1942" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ffbe03-b513-48a1-9b1b-97ceb38badda]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:15 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 Nov 05 17:48:15 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:15 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942" returned: 0 in 0.465s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:15 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942 Nov 05 17:48:15 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:15 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-96a47195-773e-4e4a-8ee8-c1b498bc1942" returned: 0 in 0.342s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-96a47195-773e-4e4a-8ee8-c1b498bc1942" released by "delete_volume" :: held 0.860s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=162,cinder:UPDATE=185,cinder:DELETE=16,cinder:INSERT=51 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Created reservations ['75481408-e630-410a-8bca-52ebd65c3227', '30516934-68ab-4c10-ad6a-8af44f1dedf0', 'b663df7e-2144-468f-ac92-dc510532ccbc', '256edfa5-3b1b-4008-9ef2-df6b63b41476'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:15 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:15 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:16 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Deleted volume successfully. Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4fbe246-0ccd-4a58-8a96-b490e55d0f38 tempest-ProjectReaderTests-1311565892 None] Lock "cinder-96a47195-773e-4e4a-8ee8-c1b498bc1942-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (0bbc3f83-42fe-4ed1-9b7e-f0b089b4db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e6585-e868-4e2a-b75b-ddfb64932f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e6585-e868-4e2a-b75b-ddfb64932f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701800733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec604900-3393-4a98-a32b-e1928de801b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:17Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcc667b-04bd-4f88-8f0f-f7363d01a31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcc667b-04bd-4f88-8f0f-f7363d01a31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e24a95-0e11-4a50-a78d-4ba40a79d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e24a95-0e11-4a50-a78d-4ba40a79d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec604900-3393-4a98-a32b-e1928de801b7', 'volume_name': 'volume-ec604900-3393-4a98-a32b-e1928de801b7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88c290e-aa8e-4ad6-a36f-b3393e115778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88c290e-aa8e-4ad6-a36f-b3393e115778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4236f397-7224-4ad4-b4c3-acf5143f116a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Volume ec604900-3393-4a98-a32b-e1928de801b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec604900-3393-4a98-a32b-e1928de801b7', 'volume_size': 1} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701800733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec604900-3393-4a98-a32b-e1928de801b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943b4b5ae2f4f17a9dd9f190ee8c1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:17Z,use_quota=True,user_id='381df86f005e4691b611d7d700757aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Creating volume ec604900-3393-4a98-a32b-e1928de801b7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:16 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 1073741824 Nov 05 17:48:16 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:17 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 1073741824" returned: 0 in 0.571s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:17 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 Nov 05 17:48:17 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:17 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4236f397-7224-4ad4-b4c3-acf5143f116a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec604900-3393-4a98-a32b-e1928de801b7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0cad16-7f4b-4ffe-8a84-5e7d499f410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Volume volume-ec604900-3393-4a98-a32b-e1928de801b7 (ec604900-3393-4a98-a32b-e1928de801b7): created successfully Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0cad16-7f4b-4ffe-8a84-5e7d499f410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Flow 'volume_create_manager' (0bbc3f83-42fe-4ed1-9b7e-f0b089b4db65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-eee81157-c21d-4039-af5e-5340ecde2c25 tempest-ProjectReaderTests-1311565892 None] Created volume successfully. Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-ec604900-3393-4a98-a32b-e1928de801b7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Lock "cinder-ec604900-3393-4a98-a32b-e1928de801b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Acquiring lock "cinder-quobyte-ec604900-3393-4a98-a32b-e1928de801b7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-ec604900-3393-4a98-a32b-e1928de801b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d787a444-2823-4724-a3bf-8cc0cb79cc96]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:19 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 Nov 05 17:48:19 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:19 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7" returned: 0 in 0.411s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:19 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7 Nov 05 17:48:19 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:19 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ec604900-3393-4a98-a32b-e1928de801b7" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Lock "cinder-quobyte-ec604900-3393-4a98-a32b-e1928de801b7" released by "delete_volume" :: held 0.749s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Created reservations ['d9a3ce98-e001-41d1-801b-edc737bed40e', '0a7b9b2d-1f51-4c6a-a837-ce6188560291', '1b7a4b3e-2553-4d21-b330-4ea760c781aa', '9a835384-2aff-4b1c-bbaf-857efd91fc04'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:20 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:20 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:20 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Deleted volume successfully. Nov 05 17:48:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c932a6c5-03ac-4ade-b12e-d640fa2ea0fa tempest-ProjectReaderTests-1311565892 None] Lock "cinder-ec604900-3393-4a98-a32b-e1928de801b7-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Flow 'volume_create_manager' (8fab31cd-283e-4a21-8129-bc391f4e9e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ea80f8-1b38-42b4-bfab-f30619143310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ea80f8-1b38-42b4-bfab-f30619143310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfb2c0b-daf5-4422-adf0-31d755f20d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c383e6ef5294a8ca7e99f307a3687c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:26Z,use_quota=True,user_id='fa293dab177b4e20882b4cb7c0bb0544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87e95ec1-a62d-4fab-94b2-f13b9bb2cd74),volume_type_id=87e95ec1-a62d-4fab-94b2-f13b9bb2cd74)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c074f4b-70ea-4e2e-b4b0-03fcc8a9f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c074f4b-70ea-4e2e-b4b0-03fcc8a9f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f09516-9cc1-49e2-8f69-68eb0097173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:25 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f09516-9cc1-49e2-8f69-68eb0097173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cfb2c0b-daf5-4422-adf0-31d755f20d51', 'volume_name': 'volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51', 'volume_size': 1, 'image_id': '8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '617494375d339b89d1f79cc7df9d0451', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c383e6ef5294a8ca7e99f307a3687c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ac6dd6a97c2ffc5d8746b910cfbd372d9670151f457f539208bfaefcb29a8a75c9aa4216e33840b6b09a27283b83015499e52c2115cbdd97b0f2c62dcb87184', 'id': '8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'created_at': datetime.datetime(2026, 11, 5, 16, 48, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 48, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d840b-fc25-4034-be74-9779c1f27972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d840b-fc25-4034-be74-9779c1f27972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb45e318-d69f-484c-afa1-e89bc9d9f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Volume 3cfb2c0b-daf5-4422-adf0-31d755f20d51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51', 'volume_size': 1, 'image_id': '8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '617494375d339b89d1f79cc7df9d0451', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c383e6ef5294a8ca7e99f307a3687c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ac6dd6a97c2ffc5d8746b910cfbd372d9670151f457f539208bfaefcb29a8a75c9aa4216e33840b6b09a27283b83015499e52c2115cbdd97b0f2c62dcb87184', 'id': '8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'created_at': datetime.datetime(2026, 11, 5, 16, 48, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 48, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Trying to clone 3cfb2c0b-daf5-4422-adf0-31d755f20d51 from image 8105cadf-a4fc-49e8-97a7-fdc683d78c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:48:26 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Image download 0.00 MB at 0.00 MB/s Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c1a443-0e60-4663-a5da-eedaf7c27149]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:26 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD Nov 05 17:48:26 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:27 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:27 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD Nov 05 17:48:27 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:27 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Temporary image 8105cadf-a4fc-49e8-97a7-fdc683d78c87 is fetched for user fa293dab177b4e20882b4cb7c0bb0544. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cfdf17-ac2f-44c0-8660-9478297decf4]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:27 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD Nov 05 17:48:27 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:27 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:28 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD Nov 05 17:48:28 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:28 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfb2c0b-daf5-4422-adf0-31d755f20d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c383e6ef5294a8ca7e99f307a3687c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:26Z,use_quota=True,user_id='fa293dab177b4e20882b4cb7c0bb0544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87e95ec1-a62d-4fab-94b2-f13b9bb2cd74),volume_type_id=87e95ec1-a62d-4fab-94b2-f13b9bb2cd74)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Creating volume 3cfb2c0b-daf5-4422-adf0-31d755f20d51 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:28 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:28 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 1073741824 Nov 05 17:48:28 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:28 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 1073741824" returned: 0 in 0.528s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:28 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 Nov 05 17:48:28 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:29 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Attempting download of 8105cadf-a4fc-49e8-97a7-fdc683d78c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'metadata': {}}])) to volume 3cfb2c0b-daf5-4422-adf0-31d755f20d51. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a84d0e-2637-438c-b5a4-64640e68d7a1]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8105cadf-a4fc-49e8-97a7-fdc683d78c87_aj767xhc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:29 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8105cadf-a4fc-49e8-97a7-fdc683d78c87_aj767xhc Nov 05 17:48:29 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:29 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8105cadf-a4fc-49e8-97a7-fdc683d78c87_aj767xhc" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8105cadf-a4fc-49e8-97a7-fdc683d78c87_aj767xhc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:29 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8105cadf-a4fc-49e8-97a7-fdc683d78c87_aj767xhc Nov 05 17:48:29 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:29 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8105cadf-a4fc-49e8-97a7-fdc683d78c87_aj767xhc" returned: 1 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8105cadf-a4fc-49e8-97a7-fdc683d78c87_aj767xhc' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca01082d-c37b-4e9b-adec-494cd7d5381e]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:30 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD Nov 05 17:48:30 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:30 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:30 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD Nov 05 17:48:30 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:30 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:48:30 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] 8105cadf-a4fc-49e8-97a7-fdc683d78c87 was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:48:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:30 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 Nov 05 17:48:30 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:31 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51" returned: 0 in 0.708s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8105cadf-a4fc-49e8-97a7-fdc683d78c87_eybe9e_ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:48:31 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:31 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 1G Nov 05 17:48:31 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:31 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 1G" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Downloaded image 8105cadf-a4fc-49e8-97a7-fdc683d78c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'metadata': {}}])) to volume 3cfb2c0b-daf5-4422-adf0-31d755f20d51 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Temporary image 8105cadf-a4fc-49e8-97a7-fdc683d78c87 for user fa293dab177b4e20882b4cb7c0bb0544 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Marking volume 3cfb2c0b-daf5-4422-adf0-31d755f20d51 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Copying metadata from image 8105cadf-a4fc-49e8-97a7-fdc683d78c87 to 3cfb2c0b-daf5-4422-adf0-31d755f20d51. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Creating volume glance metadata for volume 3cfb2c0b-daf5-4422-adf0-31d755f20d51 backed by image 8105cadf-a4fc-49e8-97a7-fdc683d78c87 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '617494375d339b89d1f79cc7df9d0451', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb45e318-d69f-484c-afa1-e89bc9d9f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51', 'volume_size': 1, 'image_id': '8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '617494375d339b89d1f79cc7df9d0451', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c383e6ef5294a8ca7e99f307a3687c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ac6dd6a97c2ffc5d8746b910cfbd372d9670151f457f539208bfaefcb29a8a75c9aa4216e33840b6b09a27283b83015499e52c2115cbdd97b0f2c62dcb87184', 'id': '8105cadf-a4fc-49e8-97a7-fdc683d78c87', 'created_at': datetime.datetime(2026, 11, 5, 16, 48, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 48, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8105cadf-a4fc-49e8-97a7-fdc683d78c87/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1406b430-a999-4aa4-80e3-bc0acdb37131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Volume volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 (3cfb2c0b-daf5-4422-adf0-31d755f20d51): created successfully Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1406b430-a999-4aa4-80e3-bc0acdb37131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Flow 'volume_create_manager' (8fab31cd-283e-4a21-8129-bc391f4e9e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4686e979-b7c1-42a6-b4f6-881279abf6ec tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Created volume successfully. Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Flow 'volume_create_manager' (c0801d96-e107-4285-ae9d-21ceeb96d3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fb98a4-593b-499e-b835-33769e0ec3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fb98a4-593b-499e-b835-33769e0ec3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-829050019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80698d0-9081-4a30-8885-e519738bd675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5069d9b11e74b219a7cf0a8ae151680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:33Z,use_quota=True,user_id='92dd8a8a644041368aa430f20dcf7358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ab63ce-6f16-4ec2-b234-c3f26ec185b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ab63ce-6f16-4ec2-b234-c3f26ec185b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6350250-95f9-4d18-8197-0d064ef82385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6350250-95f9-4d18-8197-0d064ef82385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f80698d0-9081-4a30-8885-e519738bd675', 'volume_name': 'volume-f80698d0-9081-4a30-8885-e519738bd675', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57b4c29-9cb9-4ecd-81c1-e8b59395b065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57b4c29-9cb9-4ecd-81c1-e8b59395b065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5460de8c-59f4-4326-81d9-23303d2f7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Volume f80698d0-9081-4a30-8885-e519738bd675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f80698d0-9081-4a30-8885-e519738bd675', 'volume_size': 1} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-829050019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80698d0-9081-4a30-8885-e519738bd675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5069d9b11e74b219a7cf0a8ae151680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:33Z,use_quota=True,user_id='92dd8a8a644041368aa430f20dcf7358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Creating volume f80698d0-9081-4a30-8885-e519738bd675 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:32 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:32 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 1073741824 Nov 05 17:48:32 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Flow 'volume_create_manager' (5b7a8384-136e-4ade-968e-f824ba44db31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dbe8e9-108f-4968-8d86-bcaef669c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Acquiring lock "cinder-3cfb2c0b-daf5-4422-adf0-31d755f20d51-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dbe8e9-108f-4968-8d86-bcaef669c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1568385423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a9809f-c5a6-4c16-99e9-1e751e1d648d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5069d9b11e74b219a7cf0a8ae151680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:33Z,use_quota=True,user_id='92dd8a8a644041368aa430f20dcf7358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887f7dbf-aad6-413a-8558-49629fd551f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887f7dbf-aad6-413a-8558-49629fd551f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9eee02-9b9a-4734-a4d6-eb6985a6f852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9eee02-9b9a-4734-a4d6-eb6985a6f852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a9809f-c5a6-4c16-99e9-1e751e1d648d', 'volume_name': 'volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfabc2fb-05ab-491b-be1b-8c9454c4d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfabc2fb-05ab-491b-be1b-8c9454c4d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85baa95-3795-40be-a870-aa9eec782a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Volume 54a9809f-c5a6-4c16-99e9-1e751e1d648d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d', 'volume_size': 1} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "cinder-3cfb2c0b-daf5-4422-adf0-31d755f20d51-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:33 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 1073741824" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Acquiring lock "cinder-quobyte-3cfb2c0b-daf5-4422-adf0-31d755f20d51" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "cinder-quobyte-3cfb2c0b-daf5-4422-adf0-31d755f20d51" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f8fafd-87a1-4efa-b32c-26871f86f371]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:33 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 Nov 05 17:48:33 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:33 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 Nov 05 17:48:33 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:33 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1568385423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a9809f-c5a6-4c16-99e9-1e751e1d648d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5069d9b11e74b219a7cf0a8ae151680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:33Z,use_quota=True,user_id='92dd8a8a644041368aa430f20dcf7358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Creating volume 54a9809f-c5a6-4c16-99e9-1e751e1d648d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:33 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:33 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d 1073741824 Nov 05 17:48:33 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5460de8c-59f4-4326-81d9-23303d2f7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f80698d0-9081-4a30-8885-e519738bd675', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80cf12c-d668-4e98-9394-9683b3768e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Volume volume-f80698d0-9081-4a30-8885-e519738bd675 (f80698d0-9081-4a30-8885-e519738bd675): created successfully Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80cf12c-d668-4e98-9394-9683b3768e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Flow 'volume_create_manager' (c0801d96-e107-4285-ae9d-21ceeb96d3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:33 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51" returned: 0 in 0.458s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-be743943-5438-4164-b43a-df793b06341e tempest-TestServerVolumeAttachmentScenario-765313996 None] Created volume successfully. Nov 05 17:48:33 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51 Nov 05 17:48:33 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Flow 'volume_create_manager' (1ac4ba62-437f-4dbd-a84f-7bf97c3ed906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:34 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d60e02-8401-4f0b-8218-3d623ee1290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3cfb2c0b-daf5-4422-adf0-31d755f20d51" returned: 0 in 0.423s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d60e02-8401-4f0b-8218-3d623ee1290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1137316791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4176b156-4e43-4010-9c12-d55cc9413ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77348ac0f814fa9b2c1f8058eaf624d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:34Z,use_quota=True,user_id='57061adeb0a14550acd40610fbee4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7215b410-e3d4-4060-931f-03505af26c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:34 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7215b410-e3d4-4060-931f-03505af26c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9687efe1-1aeb-4c88-aff2-71cd35d9e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9687efe1-1aeb-4c88-aff2-71cd35d9e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4176b156-4e43-4010-9c12-d55cc9413ad0', 'volume_name': 'volume-4176b156-4e43-4010-9c12-d55cc9413ad0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce2fb0e-4a38-4af7-bf99-3c726c525abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce2fb0e-4a38-4af7-bf99-3c726c525abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d82cf2-e209-43fc-81f6-d20b4f77eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Volume 4176b156-4e43-4010-9c12-d55cc9413ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4176b156-4e43-4010-9c12-d55cc9413ad0', 'volume_size': 1} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "cinder-quobyte-3cfb2c0b-daf5-4422-adf0-31d755f20d51" released by "delete_volume" :: held 0.985s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d 1073741824" returned: 0 in 0.633s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:34 devstack cinder-volume[87126]: WARNING cinder.quota [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:48:34 devstack cinder-volume[87126]: WARNING cinder.quota [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Created reservations ['6d21e0f8-0171-4a84-8a40-7c993fd3be81', 'a3c241db-07e0-4b64-8215-6d6a2dea4859', '8ca7a96b-4820-4419-9b2f-9726f3fe8f40', '7321d613-334b-4f58-9ee8-7f057f188e77'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:34 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d Nov 05 17:48:34 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:34 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:34 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:34 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1137316791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4176b156-4e43-4010-9c12-d55cc9413ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77348ac0f814fa9b2c1f8058eaf624d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:34Z,use_quota=True,user_id='57061adeb0a14550acd40610fbee4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Creating volume 4176b156-4e43-4010-9c12-d55cc9413ad0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85baa95-3795-40be-a870-aa9eec782a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15182bbc-ac26-42bf-bfaa-0dcc3c79c132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:34 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 1073741824 Nov 05 17:48:34 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Volume volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d (54a9809f-c5a6-4c16-99e9-1e751e1d648d): created successfully Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15182bbc-ac26-42bf-bfaa-0dcc3c79c132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:34 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Flow 'volume_create_manager' (5b7a8384-136e-4ade-968e-f824ba44db31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Deleted volume successfully. Nov 05 17:48:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8086c875-ba20-47ed-93b8-93099f9bd1e3 tempest-TestServerVolumeAttachmentScenario-765313996 None] Created volume successfully. Nov 05 17:48:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f1e1cc9-247b-4f1c-89bb-ba506763ee14 tempest-VolumeAndVolumeTypeFromImageTest-521350297 None] Lock "cinder-3cfb2c0b-daf5-4422-adf0-31d755f20d51-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:35 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 1073741824" returned: 0 in 0.507s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:35 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 Nov 05 17:48:35 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:35 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d82cf2-e209-43fc-81f6-d20b4f77eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4176b156-4e43-4010-9c12-d55cc9413ad0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383f08dc-3142-48dd-a316-e8e58fafe385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Volume volume-4176b156-4e43-4010-9c12-d55cc9413ad0 (4176b156-4e43-4010-9c12-d55cc9413ad0): created successfully Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383f08dc-3142-48dd-a316-e8e58fafe385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Flow 'volume_create_manager' (1ac4ba62-437f-4dbd-a84f-7bf97c3ed906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a9e57a7e-e560-481e-ab18-d67f3aad68f9 tempest-VolumesListAdminTestJSON-2074017759 None] Created volume successfully. Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Flow 'volume_create_manager' (367d28b8-955c-4ebb-bf53-3c5ee291c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6477970f-e2d5-4bd8-b214-b54afec06080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6477970f-e2d5-4bd8-b214-b54afec06080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-482073016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c045ac9f-42f7-44f5-aa38-344421964071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77348ac0f814fa9b2c1f8058eaf624d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:37Z,use_quota=True,user_id='57061adeb0a14550acd40610fbee4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5415f497-f6b6-408f-98c9-1e0f5af0fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5415f497-f6b6-408f-98c9-1e0f5af0fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fb3d66-88f0-42cd-bd31-4b01c44d3d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fb3d66-88f0-42cd-bd31-4b01c44d3d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c045ac9f-42f7-44f5-aa38-344421964071', 'volume_name': 'volume-c045ac9f-42f7-44f5-aa38-344421964071', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f80e2a-3054-4578-b05e-4098d58fcee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f80e2a-3054-4578-b05e-4098d58fcee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d5d36-8c34-48d7-a6a2-40620a3a10e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Volume c045ac9f-42f7-44f5-aa38-344421964071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c045ac9f-42f7-44f5-aa38-344421964071', 'volume_size': 1} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-482073016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c045ac9f-42f7-44f5-aa38-344421964071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77348ac0f814fa9b2c1f8058eaf624d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:37Z,use_quota=True,user_id='57061adeb0a14550acd40610fbee4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Creating volume c045ac9f-42f7-44f5-aa38-344421964071 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:37 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 1073741824 Nov 05 17:48:37 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:37 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 1073741824" returned: 0 in 0.533s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:37 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 Nov 05 17:48:37 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:38 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071" returned: 0 in 0.488s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d5d36-8c34-48d7-a6a2-40620a3a10e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c045ac9f-42f7-44f5-aa38-344421964071', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5c61e3-62ae-4c6f-84c6-cd250ceaf30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Volume volume-c045ac9f-42f7-44f5-aa38-344421964071 (c045ac9f-42f7-44f5-aa38-344421964071): created successfully Nov 05 17:48:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5c61e3-62ae-4c6f-84c6-cd250ceaf30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Flow 'volume_create_manager' (367d28b8-955c-4ebb-bf53-3c5ee291c469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8403d96b-769e-467c-b4ad-c3ceb342dd97 tempest-VolumesListAdminTestJSON-2074017759 None] Created volume successfully. Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Flow 'volume_create_manager' (7bf2bb1d-94d5-4ad7-9a83-d69b4227cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da620a87-2211-4666-ab5f-d6ded95210ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da620a87-2211-4666-ab5f-d6ded95210ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352235457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e728557d-374d-4ad4-9238-9fcaf0f3c0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77348ac0f814fa9b2c1f8058eaf624d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:40Z,use_quota=True,user_id='57061adeb0a14550acd40610fbee4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5d1a0b-e6bf-41a8-b3fd-d14193b65306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5d1a0b-e6bf-41a8-b3fd-d14193b65306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be91be25-d34c-4cdf-b5e6-b0d17ab88905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be91be25-d34c-4cdf-b5e6-b0d17ab88905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e728557d-374d-4ad4-9238-9fcaf0f3c0f1', 'volume_name': 'volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8794dcb1-3e52-4ef0-ba84-a683f8f9faf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8794dcb1-3e52-4ef0-ba84-a683f8f9faf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0beeea-df78-44a2-998b-3ee732907d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Volume e728557d-374d-4ad4-9238-9fcaf0f3c0f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1', 'volume_size': 1} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352235457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e728557d-374d-4ad4-9238-9fcaf0f3c0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77348ac0f814fa9b2c1f8058eaf624d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:40Z,use_quota=True,user_id='57061adeb0a14550acd40610fbee4f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Creating volume e728557d-374d-4ad4-9238-9fcaf0f3c0f1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:39 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:39 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 1073741824 Nov 05 17:48:39 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:40 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 1073741824" returned: 0 in 0.533s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:40 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 Nov 05 17:48:40 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:40 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0beeea-df78-44a2-998b-3ee732907d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900f022f-6b34-46b1-bca1-5db86f69908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Volume volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 (e728557d-374d-4ad4-9238-9fcaf0f3c0f1): created successfully Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900f022f-6b34-46b1-bca1-5db86f69908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Flow 'volume_create_manager' (7bf2bb1d-94d5-4ad7-9a83-d69b4227cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f4a6f605-7a88-4a49-b2ef-8fd4753cf8c4 tempest-VolumesListAdminTestJSON-2074017759 None] Created volume successfully. Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (fc8a658d-fa1f-4d83-8eee-83c4268d1998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3eac95-717c-4df8-b02b-2221b37320e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3eac95-717c-4df8-b02b-2221b37320e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364050363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f70711-a6bc-40ad-a34c-89cc152af0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:41Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e21105-f185-44ee-a4d8-0a721eaf0424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e21105-f185-44ee-a4d8-0a721eaf0424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dd5e9a-9659-46a6-96ad-6780f7295923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dd5e9a-9659-46a6-96ad-6780f7295923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f70711-a6bc-40ad-a34c-89cc152af0f8', 'volume_name': 'volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c65ca6e-f3d4-47d5-872e-73dfa681be1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c65ca6e-f3d4-47d5-872e-73dfa681be1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe0be75-0c06-4e9c-9310-876fedfc9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume d5f70711-a6bc-40ad-a34c-89cc152af0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8', 'volume_size': 1} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364050363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f70711-a6bc-40ad-a34c-89cc152af0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:41Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Creating volume d5f70711-a6bc-40ad-a34c-89cc152af0f8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:41 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 1073741824 Nov 05 17:48:41 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:42 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 1073741824" returned: 0 in 0.930s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:42 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 Nov 05 17:48:42 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:43 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8" returned: 0 in 0.451s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe0be75-0c06-4e9c-9310-876fedfc9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f671e45-ac17-48dc-a4fe-7762b18d3a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 (d5f70711-a6bc-40ad-a34c-89cc152af0f8): created successfully Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f671e45-ac17-48dc-a4fe-7762b18d3a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (fc8a658d-fa1f-4d83-8eee-83c4268d1998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-85c45a00-cbf2-43a7-898d-996e45a33d48 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created volume successfully. Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Flow 'volume_create_manager' (262ebbef-69de-4cf2-940c-f97f3f12af13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538a922d-8b57-4abe-ae2d-f6744620b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538a922d-8b57-4abe-ae2d-f6744620b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5aa377ce0fe4ce5959501a7f54b6403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:43Z,use_quota=True,user_id='c8ca8b7d5a384c019b765845b4212180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85501c9d-bf3b-4b91-9a64-a3702f92fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85501c9d-bf3b-4b91-9a64-a3702f92fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f801ff-0ab0-45fb-9184-5b4a4ac53533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f801ff-0ab0-45fb-9184-5b4a4ac53533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f', 'volume_name': 'volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c4056a-4fb9-4d9c-882c-a2105fe1152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c4056a-4fb9-4d9c-882c-a2105fe1152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5414a8f-62a6-4249-bf15-6b239cda551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Volume 09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f', 'volume_size': 1} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5aa377ce0fe4ce5959501a7f54b6403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:43Z,use_quota=True,user_id='c8ca8b7d5a384c019b765845b4212180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Creating volume 09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:43 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:43 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f 1073741824 Nov 05 17:48:43 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:44 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f 1073741824" returned: 0 in 0.755s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (f3ca3c1e-d745-447c-8623-f9932d5a18ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bc6f7a-3d3b-4c57-8565-c7b49998488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bc6f7a-3d3b-4c57-8565-c7b49998488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-67857380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:44Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb4cb18-e064-4644-9bb2-033e477ba2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb4cb18-e064-4644-9bb2-033e477ba2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6418d1d4-528b-4913-b5c5-159a05988cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6418d1d4-528b-4913-b5c5-159a05988cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a', 'volume_name': 'volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a55ece0-d724-40a1-b992-78450649e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a55ece0-d724-40a1-b992-78450649e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8904c-4cad-46ca-ac80-450f20eac0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume 0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a', 'volume_size': 1} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:44 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f" returned: 0 in 0.429s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.359s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-67857380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:44Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Creating volume 0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:44 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5414a8f-62a6-4249-bf15-6b239cda551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a 1073741824 Nov 05 17:48:44 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9089b59-37ca-4df6-898c-abce4c702666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Volume volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f (09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f): created successfully Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9089b59-37ca-4df6-898c-abce4c702666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Flow 'volume_create_manager' (262ebbef-69de-4cf2-940c-f97f3f12af13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d43005bc-b84e-4169-b224-dcb44011ae5e tempest-VolumesListAdminTestJSON-1717550505 None] Created volume successfully. Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (bfc980e8-ba1d-4b51-ad0f-87d411e32359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927a43d2-d91d-4997-8021-88016c112efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927a43d2-d91d-4997-8021-88016c112efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942918923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eb4586-e4e4-4e69-b0f0-92953632fabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:45Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf80fc5-53a8-4924-8a17-fed30cc31634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf80fc5-53a8-4924-8a17-fed30cc31634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3021b6d1-8f93-4c79-bc0c-f6b0bb52b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3021b6d1-8f93-4c79-bc0c-f6b0bb52b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eb4586-e4e4-4e69-b0f0-92953632fabc', 'volume_name': 'volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff47811b-b7d8-4afc-93db-7b791c003ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff47811b-b7d8-4afc-93db-7b791c003ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3b30b1-89ab-4225-9d51-57d3878426c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume d8eb4586-e4e4-4e69-b0f0-92953632fabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc', 'volume_size': 1} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:45 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (c9ba1bea-01a4-47c4-b3a5-adbb59d32251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8516b1-f7dc-460e-96e1-3a32b3e5d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a 1073741824" returned: 0 in 0.887s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8516b1-f7dc-460e-96e1-3a32b3e5d963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-251036673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2292a9cf-b384-4b78-8d29-69656dfb9233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:45Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dd05e7-2039-4bdf-bad8-ea587982411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dd05e7-2039-4bdf-bad8-ea587982411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11037593-73b1-44d7-84ba-daf5a3835c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11037593-73b1-44d7-84ba-daf5a3835c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2292a9cf-b384-4b78-8d29-69656dfb9233', 'volume_name': 'volume-2292a9cf-b384-4b78-8d29-69656dfb9233', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141a3322-0064-4278-a14a-a7ab10ddaa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141a3322-0064-4278-a14a-a7ab10ddaa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c847e3-47af-4652-adda-facca8a23017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume 2292a9cf-b384-4b78-8d29-69656dfb9233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2292a9cf-b384-4b78-8d29-69656dfb9233', 'volume_size': 1} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Acquiring lock "cinder-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Lock "cinder-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Acquiring lock "cinder-quobyte-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:45 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a Nov 05 17:48:45 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Lock "cinder-quobyte-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b9443e-4fef-4e9f-af6c-111d54ed00fe]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "cinder-e728557d-374d-4ad4-9238-9fcaf0f3c0f1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-e728557d-374d-4ad4-9238-9fcaf0f3c0f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "cinder-quobyte-e728557d-374d-4ad4-9238-9fcaf0f3c0f1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-quobyte-e728557d-374d-4ad4-9238-9fcaf0f3c0f1" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9be6c-f82f-4292-8e0d-6fea4ce2bc6b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:46 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f Nov 05 17:48:46 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:46 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:46 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 Nov 05 17:48:46 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (6045225d-5412-4e44-9c04-47cddc3ea547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963d29b7-7277-4ca3-97b2-ded4273c2639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a" returned: 0 in 0.599s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942918923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eb4586-e4e4-4e69-b0f0-92953632fabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:45Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Creating volume d8eb4586-e4e4-4e69-b0f0-92953632fabc {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:46 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963d29b7-7277-4ca3-97b2-ded4273c2639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890332524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757121e3-009d-47ed-b800-fbd6cca90a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:46Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:46 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc 1073741824 Nov 05 17:48:46 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dbcb5e-91af-4530-bc30-bf1c84c1d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dbcb5e-91af-4530-bc30-bf1c84c1d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2225572c-b02b-4b6f-b15f-fe65b0f83d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2225572c-b02b-4b6f-b15f-fe65b0f83d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757121e3-009d-47ed-b800-fbd6cca90a2f', 'volume_name': 'volume-757121e3-009d-47ed-b800-fbd6cca90a2f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94c7ad6-df5e-460e-a171-34ebee56ebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94c7ad6-df5e-460e-a171-34ebee56ebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c3ea1f-cede-48e2-abd2-108fdd44f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:46 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume 757121e3-009d-47ed-b800-fbd6cca90a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757121e3-009d-47ed-b800-fbd6cca90a2f', 'volume_size': 1} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8904c-4cad-46ca-ac80-450f20eac0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf630b9-3433-49af-9dee-7540d7f69c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:46 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a (0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a): created successfully Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf630b9-3433-49af-9dee-7540d7f69c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (f3ca3c1e-d745-447c-8623-f9932d5a18ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-946bdeda-49b8-44f3-9120-8295becd1a28 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created volume successfully. Nov 05 17:48:46 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1" returned: 0 in 0.625s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:46 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1 Nov 05 17:48:46 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:46 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f" returned: 0 in 1.009s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:46 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f Nov 05 17:48:46 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (a8c526e5-2334-42ac-887d-c86328be5084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8875984e-0e7a-4d7f-95b5-33b41a79f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8875984e-0e7a-4d7f-95b5-33b41a79f563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846561403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc07fb09-10f9-46ed-90d9-cec665b4537b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:47Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fb4a71-60ab-4610-bb85-5d94a13af1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fb4a71-60ab-4610-bb85-5d94a13af1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95da4c5f-9e64-4579-ada7-f72cb446d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:47 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95da4c5f-9e64-4579-ada7-f72cb446d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc07fb09-10f9-46ed-90d9-cec665b4537b', 'volume_name': 'volume-cc07fb09-10f9-46ed-90d9-cec665b4537b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2a4e23-e49c-4a4f-9124-2c5a0ae6a1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2a4e23-e49c-4a4f-9124-2c5a0ae6a1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f68c212-0061-44ea-94c2-6e21dcfde599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume cc07fb09-10f9-46ed-90d9-cec665b4537b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc07fb09-10f9-46ed-90d9-cec665b4537b', 'volume_size': 1} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e728557d-374d-4ad4-9238-9fcaf0f3c0f1" returned: 0 in 0.418s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:47 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc 1073741824" returned: 0 in 0.801s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-quobyte-e728557d-374d-4ad4-9238-9fcaf0f3c0f1" released by "delete_volume" :: held 1.144s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:47 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc Nov 05 17:48:47 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Created reservations ['466b42e9-8d83-4df2-84fb-47f4db460343', '03e160c2-c9b8-4ce4-9591-2ebc0c6479e3', '0ed30a4d-8f10-48b4-af37-bf21d09c5f54', '439df2fe-de72-44a9-a009-4c1883169af4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:47 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f" returned: 0 in 0.540s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Lock "cinder-quobyte-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f" released by "delete_volume" :: held 1.647s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:47 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:47 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Created reservations ['f86c5a6d-59dc-4fdc-b3b6-754dc44f90ee', '24b358b4-6933-4af4-bbc6-1dc2f74f87ff', '12ee83a5-7970-495b-a7bb-cb43f6560541', '95d3ee7b-6e71-49f3-838e-556fbe92fc76'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:47 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-251036673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2292a9cf-b384-4b78-8d29-69656dfb9233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:45Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Creating volume 2292a9cf-b384-4b78-8d29-69656dfb9233 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:47 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:47 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 1073741824 Nov 05 17:48:47 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3b30b1-89ab-4225-9d51-57d3878426c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb940859-9194-402c-80ea-f0a452dfc955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc (d8eb4586-e4e4-4e69-b0f0-92953632fabc): created successfully Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb940859-9194-402c-80ea-f0a452dfc955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (bfc980e8-ba1d-4b51-ad0f-87d411e32359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:47 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.436s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5a34d3b3-2dc6-4687-bdde-d473b7f049c6 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created volume successfully. Nov 05 17:48:47 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:47 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Deleted volume successfully. Nov 05 17:48:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b263d26-2ed8-40be-bf16-e8481344e9af tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-e728557d-374d-4ad4-9238-9fcaf0f3c0f1-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:48 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Deleted volume successfully. Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f522ba3e-d92f-4082-9167-d4004aae82e3 tempest-VolumesListAdminTestJSON-1717550505 None] Lock "cinder-09ab6332-db8c-4bd4-8c9c-33c0b9d37b0f-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:48 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 1073741824" returned: 0 in 0.592s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:48 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 Nov 05 17:48:48 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "cinder-c045ac9f-42f7-44f5-aa38-344421964071-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-c045ac9f-42f7-44f5-aa38-344421964071-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "cinder-quobyte-c045ac9f-42f7-44f5-aa38-344421964071" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-quobyte-c045ac9f-42f7-44f5-aa38-344421964071" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f615cd36-ab34-4899-86c2-c854cc2600e3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:48 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890332524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757121e3-009d-47ed-b800-fbd6cca90a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:46Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Creating volume 757121e3-009d-47ed-b800-fbd6cca90a2f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:48 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:48 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f 1073741824 Nov 05 17:48:48 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c847e3-47af-4652-adda-facca8a23017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2292a9cf-b384-4b78-8d29-69656dfb9233', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:48 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 Nov 05 17:48:48 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafa653c-8534-46de-90ec-65fea2dd613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume volume-2292a9cf-b384-4b78-8d29-69656dfb9233 (2292a9cf-b384-4b78-8d29-69656dfb9233): created successfully Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafa653c-8534-46de-90ec-65fea2dd613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (c9ba1bea-01a4-47c4-b3a5-adbb59d32251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-201fcbad-46fe-4672-b1f1-93b697731c53 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created volume successfully. Nov 05 17:48:48 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071" returned: 0 in 0.476s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:49 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071 Nov 05 17:48:49 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:49 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f 1073741824" returned: 0 in 0.529s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:49 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f Nov 05 17:48:49 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:49 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c045ac9f-42f7-44f5-aa38-344421964071" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-quobyte-c045ac9f-42f7-44f5-aa38-344421964071" released by "delete_volume" :: held 0.797s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Created reservations ['08fb2875-c57a-46a5-ace4-30b370473aff', 'c11257e0-87d7-4cc5-b23a-269692be3db5', '2f816842-c695-4d3e-8bab-427c7cbfdf9f', '63271648-6744-4817-90b6-7a94bf5a6d38'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:49 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:49 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:49 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.370s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846561403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc07fb09-10f9-46ed-90d9-cec665b4537b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b960631ce2664bc3be8cd6319b629be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:48:47Z,use_quota=True,user_id='28b7830a27a24e8ab574cc6b8b08e8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Creating volume cc07fb09-10f9-46ed-90d9-cec665b4537b {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:48:49 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:49 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b 1073741824 Nov 05 17:48:49 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c3ea1f-cede-48e2-abd2-108fdd44f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757121e3-009d-47ed-b800-fbd6cca90a2f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5741ba63-f640-4b4c-9ba7-90f09f5c824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:49 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume volume-757121e3-009d-47ed-b800-fbd6cca90a2f (757121e3-009d-47ed-b800-fbd6cca90a2f): created successfully Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5741ba63-f640-4b4c-9ba7-90f09f5c824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (6045225d-5412-4e44-9c04-47cddc3ea547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d7ba6eff-a111-4629-a7a0-edad5f087041 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created volume successfully. Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "cinder-4176b156-4e43-4010-9c12-d55cc9413ad0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:49 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Deleted volume successfully. Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-4176b156-4e43-4010-9c12-d55cc9413ad0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d7180153-a9fd-4205-b5c6-f5d6030d002f tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-c045ac9f-42f7-44f5-aa38-344421964071-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "cinder-quobyte-4176b156-4e43-4010-9c12-d55cc9413ad0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-quobyte-4176b156-4e43-4010-9c12-d55cc9413ad0" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ba85e-db8b-45e4-88e1-a51910107104]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:49 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 Nov 05 17:48:49 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:50 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b 1073741824" returned: 0 in 0.539s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:50 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b Nov 05 17:48:50 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:50 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0" returned: 0 in 0.400s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:50 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0 Nov 05 17:48:50 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:50 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b" returned: 0 in 0.295s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f68c212-0061-44ea-94c2-6e21dcfde599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc07fb09-10f9-46ed-90d9-cec665b4537b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfade5b-d0e7-4f4f-889a-6c30ccf13897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:48:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Volume volume-cc07fb09-10f9-46ed-90d9-cec665b4537b (cc07fb09-10f9-46ed-90d9-cec665b4537b): created successfully Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfade5b-d0e7-4f4f-889a-6c30ccf13897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Flow 'volume_create_manager' (a8c526e5-2334-42ac-887d-c86328be5084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:48:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-749ac674-bb57-410b-9f34-dda5656531d0 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created volume successfully. Nov 05 17:48:50 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4176b156-4e43-4010-9c12-d55cc9413ad0" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-quobyte-4176b156-4e43-4010-9c12-d55cc9413ad0" released by "delete_volume" :: held 0.724s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Created reservations ['2bb36500-3a72-453d-899c-9c2f73d30cd7', '678ea0a7-5894-47b0-a704-61b0ab3cfa48', 'b4662209-756a-4328-b799-f1957dc4e302', 'b84b44e4-3a62-4284-9ea0-fb636bbbecd5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:50 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:50 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:50 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Deleted volume successfully. Nov 05 17:48:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-987d8d15-a2dd-4b8b-aba3-7b67687dd14b tempest-VolumesListAdminTestJSON-2074017759 None] Lock "cinder-4176b156-4e43-4010-9c12-d55cc9413ad0-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-cc07fb09-10f9-46ed-90d9-cec665b4537b-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-cc07fb09-10f9-46ed-90d9-cec665b4537b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-quobyte-cc07fb09-10f9-46ed-90d9-cec665b4537b" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-cc07fb09-10f9-46ed-90d9-cec665b4537b" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a06ffa-d8d7-45bb-a1ec-a557bdd87845]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:51 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b Nov 05 17:48:51 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:51 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b" returned: 0 in 0.399s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:52 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b Nov 05 17:48:52 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:52 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc07fb09-10f9-46ed-90d9-cec665b4537b" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-cc07fb09-10f9-46ed-90d9-cec665b4537b" released by "delete_volume" :: held 0.754s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created reservations ['716ed189-87b6-41e4-aaf2-d539ef0ecde5', '35595bb3-121e-49cd-8484-afd4ba56af37', 'd1de4a75-160a-423e-987f-152251baa6a9', 'e8fa0629-934f-4373-bb34-1cfe0c48722d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:52 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:52 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-757121e3-009d-47ed-b800-fbd6cca90a2f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-757121e3-009d-47ed-b800-fbd6cca90a2f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-quobyte-757121e3-009d-47ed-b800-fbd6cca90a2f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-757121e3-009d-47ed-b800-fbd6cca90a2f" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:52 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.431s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb18829-3900-49c8-8f8b-ac3d7dbaa63f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Deleted volume successfully. Nov 05 17:48:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fa249aac-963b-430d-9d03-b27f778dffa8 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-cc07fb09-10f9-46ed-90d9-cec665b4537b-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:53 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f Nov 05 17:48:53 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:53 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f" returned: 0 in 0.461s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:53 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f Nov 05 17:48:53 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:53 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-757121e3-009d-47ed-b800-fbd6cca90a2f" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-757121e3-009d-47ed-b800-fbd6cca90a2f" released by "delete_volume" :: held 0.839s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created reservations ['a365ef4c-2400-4251-87d8-c0fd77ec4b04', 'bdf0f894-8c49-471f-9441-eae1260a56a6', '9bb10aa7-450c-4502-946a-7585a89c8f2b', '331d19b3-8884-4360-92f3-5fb252e3b675'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:53 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:53 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-2292a9cf-b384-4b78-8d29-69656dfb9233-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-2292a9cf-b384-4b78-8d29-69656dfb9233-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-quobyte-2292a9cf-b384-4b78-8d29-69656dfb9233" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-2292a9cf-b384-4b78-8d29-69656dfb9233" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c0284b-d9ef-4f82-bc23-df0ad46db3f1]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:54 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Deleted volume successfully. Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2673a85a-0974-4806-b6d3-08a384bad470 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-757121e3-009d-47ed-b800-fbd6cca90a2f-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:54 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 Nov 05 17:48:54 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:54 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233" returned: 0 in 0.425s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:54 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233 Nov 05 17:48:54 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:54 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2292a9cf-b384-4b78-8d29-69656dfb9233" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-2292a9cf-b384-4b78-8d29-69656dfb9233" released by "delete_volume" :: held 0.771s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created reservations ['68cb03c2-1862-4e14-a1c1-b4734336a6bc', '39feb919-9b2e-4cca-92f2-8c4922f7bee0', '9eba2289-3f70-44f7-b781-934f87c27332', '63886837-abc0-4f40-84d8-d2c10745b6c1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:55 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:55 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-d8eb4586-e4e4-4e69-b0f0-92953632fabc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-d8eb4586-e4e4-4e69-b0f0-92953632fabc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-quobyte-d8eb4586-e4e4-4e69-b0f0-92953632fabc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-d8eb4586-e4e4-4e69-b0f0-92953632fabc" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:55 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Deleted volume successfully. Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eb9a18-e149-4136-a34d-9c1b8266d901]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f69900b7-de70-45e7-8a80-0c036295a484 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-2292a9cf-b384-4b78-8d29-69656dfb9233-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:55 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc Nov 05 17:48:55 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:55 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc" returned: 0 in 0.452s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:55 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc Nov 05 17:48:55 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:56 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d8eb4586-e4e4-4e69-b0f0-92953632fabc" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-d8eb4586-e4e4-4e69-b0f0-92953632fabc" released by "delete_volume" :: held 0.791s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created reservations ['fe4442b4-8932-4bf2-a52d-f5afc2048e30', 'b43d6c39-7cdc-4a9b-b4e5-d9ba9cef6fbe', '77f9236b-3369-4ceb-bfc8-7e556e9c781b', '174bb71d-78fb-4c83-8186-ea72ea8eacc2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:56 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:56 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-quobyte-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f68d8b-04f3-4a26-9da1-58749a72cc47]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:56 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Deleted volume successfully. Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-98ab6323-52f9-46c0-a652-e4eaa12f2add tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-d8eb4586-e4e4-4e69-b0f0-92953632fabc-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:56 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a Nov 05 17:48:56 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:56 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:57 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a Nov 05 17:48:57 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:57 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a" released by "delete_volume" :: held 0.695s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created reservations ['5e640167-95b3-4aef-990d-e7cc2cdeb576', 'd6bf5b5a-7dbe-4a5e-a637-a024071394e3', '1f7272bb-73e1-4d66-9aae-a1210e359f02', 'de7c2b03-df69-470e-98a4-a9ab2fc6acc8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:57 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:57 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:57 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Deleted volume successfully. Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c39ef1d-e895-4f4b-9933-97cc87876c41 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-0f27fea2-88b8-4bbc-8bfa-d43dc1ce567a-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-d5f70711-a6bc-40ad-a34c-89cc152af0f8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-d5f70711-a6bc-40ad-a34c-89cc152af0f8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "cinder-quobyte-d5f70711-a6bc-40ad-a34c-89cc152af0f8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-d5f70711-a6bc-40ad-a34c-89cc152af0f8" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afa8b8b-f8ce-400f-8bd1-49dc6f36b201]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:48:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:57 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 Nov 05 17:48:57 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:58 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8" returned: 0 in 0.398s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:58 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8 Nov 05 17:48:58 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:58 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d5f70711-a6bc-40ad-a34c-89cc152af0f8" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-quobyte-d5f70711-a6bc-40ad-a34c-89cc152af0f8" released by "delete_volume" :: held 0.721s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Created reservations ['caffe8d5-9c1f-40c9-9f2e-ec3f94affa1b', '2032c50d-0743-4fa3-b213-0c2a3cb3b28b', '68df8a69-2944-459a-a28e-ad3bcc516ec6', '337c683a-45a2-451a-ba94-92274f3715f5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:48:58 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:48:58 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:48:58 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:48:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Deleted volume successfully. Nov 05 17:48:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9644cf97-f71e-4eab-95e4-752b2f7404a1 tempest-CreateVolumesFromSourceVolumeTest-1970452220 None] Lock "cinder-d5f70711-a6bc-40ad-a34c-89cc152af0f8-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Flow 'volume_create_manager' (e15002e5-3105-49a3-86ef-6131feab0033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39900c66-8b63-4042-b461-bd14a100e865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39900c66-8b63-4042-b461-bd14a100e865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2128800483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13594390-c903-4eec-bc85-cbf99c9827d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee654af5932244db9c872ed9f91caad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:00Z,use_quota=True,user_id='395d656afa5f47109c67aff24fc361ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3c226c-5e06-4a07-b0d4-a6813c7acae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3c226c-5e06-4a07-b0d4-a6813c7acae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0457afe8-3027-4e42-b7a0-f333e3aad935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0457afe8-3027-4e42-b7a0-f333e3aad935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13594390-c903-4eec-bc85-cbf99c9827d8', 'volume_name': 'volume-13594390-c903-4eec-bc85-cbf99c9827d8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871f3440-4ecd-4719-bb47-0921d6056ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871f3440-4ecd-4719-bb47-0921d6056ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baa88e5-e355-4347-8091-c5e348cdf663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:00 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Volume 13594390-c903-4eec-bc85-cbf99c9827d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13594390-c903-4eec-bc85-cbf99c9827d8', 'volume_size': 1} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2128800483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13594390-c903-4eec-bc85-cbf99c9827d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee654af5932244db9c872ed9f91caad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:00Z,use_quota=True,user_id='395d656afa5f47109c67aff24fc361ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Creating volume 13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:00 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:00 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 1073741824 Nov 05 17:49:00 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:00 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 1073741824" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:00 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 Nov 05 17:49:00 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:00 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baa88e5-e355-4347-8091-c5e348cdf663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13594390-c903-4eec-bc85-cbf99c9827d8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62ade16-ef08-4ab2-abd0-6aac65311c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Volume volume-13594390-c903-4eec-bc85-cbf99c9827d8 (13594390-c903-4eec-bc85-cbf99c9827d8): created successfully Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62ade16-ef08-4ab2-abd0-6aac65311c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Flow 'volume_create_manager' (e15002e5-3105-49a3-86ef-6131feab0033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0b6e1b3d-c718-46a1-a6d6-d5685cb8a101 tempest-SnapshotMetadataTestJSON-1858291795 None] Created volume successfully. Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Flow 'volume_create_manager' (820281c6-6d00-45f9-9d4d-a2aeb673ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83abb8e-ebe0-46d6-ac4a-b9f2bd09cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83abb8e-ebe0-46d6-ac4a-b9f2bd09cf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ca144a-d9e5-4635-bbba-1c5417f6bcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61dc931ec874f2f9916b10956010de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:02Z,use_quota=True,user_id='8c0bda2a32b9449f90b52b449ae24ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d773148f-f7c0-42ba-9772-5cb1039e6e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d773148f-f7c0-42ba-9772-5cb1039e6e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb10502a-7e05-45e4-ba67-7ffc2c091cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb10502a-7e05-45e4-ba67-7ffc2c091cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ca144a-d9e5-4635-bbba-1c5417f6bcd8', 'volume_name': 'volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc95dfd1-2de0-4512-a0fa-23707496a4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc95dfd1-2de0-4512-a0fa-23707496a4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb14773d-f005-4233-b675-da9ca15ee9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Volume 17ca144a-d9e5-4635-bbba-1c5417f6bcd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8', 'volume_size': 1} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ca144a-d9e5-4635-bbba-1c5417f6bcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61dc931ec874f2f9916b10956010de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:02Z,use_quota=True,user_id='8c0bda2a32b9449f90b52b449ae24ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Creating volume 17ca144a-d9e5-4635-bbba-1c5417f6bcd8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:02 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 1073741824 Nov 05 17:49:02 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:02 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 1073741824" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:02 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 Nov 05 17:49:02 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:02 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.447s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb14773d-f005-4233-b675-da9ca15ee9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9925fb-8ee8-4823-8abf-f2bff5d41976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Creating offline snapshot da8545ad-96ff-45eb-9451-76eb978898da of volume 13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:49:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Volume volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 (17ca144a-d9e5-4635-bbba-1c5417f6bcd8): created successfully Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9925fb-8ee8-4823-8abf-f2bff5d41976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Flow 'volume_create_manager' (820281c6-6d00-45f9-9d4d-a2aeb673ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[10008a09-f74b-4b13-b531-758599d1dc38]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f7472e0b-06db-4f7b-9fb4-ef766f67c33a tempest-CinderUnicodeTest-801617915 None] Created volume successfully. Nov 05 17:49:02 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 Nov 05 17:49:03 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:03 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:03 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da 1G Nov 05 17:49:03 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:03 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da 1G" returned: 0 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13594390-c903-4eec-bc85-cbf99c9827d8 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:03 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13594390-c903-4eec-bc85-cbf99c9827d8 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da Nov 05 17:49:03 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:03 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13594390-c903-4eec-bc85-cbf99c9827d8 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da" returned: 0 in 0.304s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:03 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da is being set with open permissions: ugo+rw Nov 05 17:49:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:03 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da Nov 05 17:49:03 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:04 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:04 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.info Nov 05 17:49:04 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:04 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.info" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:04 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.info is being set with open permissions: ugo+rw Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:04 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.info Nov 05 17:49:04 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Flow 'volume_create_manager' (86303db3-4479-4674-ae49-bf70158d508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f346d1d5-2a33-4077-89f5-62bdf4ce9aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f346d1d5-2a33-4077-89f5-62bdf4ce9aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-259514903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcc7ed2-c19f-477d-bd0c-5b2f50e92fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61dc931ec874f2f9916b10956010de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:05Z,use_quota=True,user_id='8c0bda2a32b9449f90b52b449ae24ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a356e4d5-4ea0-4049-9ac8-d49aa865ea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a356e4d5-4ea0-4049-9ac8-d49aa865ea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97edd81e-6549-4a8a-8b47-dac6627077f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97edd81e-6549-4a8a-8b47-dac6627077f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efcc7ed2-c19f-477d-bd0c-5b2f50e92fba', 'volume_name': 'volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1411abac-172e-448d-94e8-68563891d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1411abac-172e-448d-94e8-68563891d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2faad1-9b57-4d0c-8673-5ee4a553cac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Volume efcc7ed2-c19f-477d-bd0c-5b2f50e92fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba', 'volume_size': 1} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:04 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.info" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-259514903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcc7ed2-c19f-477d-bd0c-5b2f50e92fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61dc931ec874f2f9916b10956010de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:05Z,use_quota=True,user_id='8c0bda2a32b9449f90b52b449ae24ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Creating volume efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:04 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:04 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba 1073741824 Nov 05 17:49:04 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a3382cfe-515a-41ab-8773-c1dca9ee9c2d tempest-SnapshotMetadataTestJSON-1858291795 None] Create snapshot completed successfully Nov 05 17:49:05 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba 1073741824" returned: 0 in 0.423s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:05 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba Nov 05 17:49:05 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:05 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2faad1-9b57-4d0c-8673-5ee4a553cac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfc1b64-d7b8-40d4-95f4-1e5f21be712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Volume volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba (efcc7ed2-c19f-477d-bd0c-5b2f50e92fba): created successfully Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfc1b64-d7b8-40d4-95f4-1e5f21be712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Flow 'volume_create_manager' (86303db3-4479-4674-ae49-bf70158d508b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fa29006a-b8b2-4c1b-bd8f-d4386468c2a4 tempest-CinderUnicodeTest-801617915 None] Created volume successfully. Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-5d141504-f87f-4cc1-833b-c453e88fc2be req-5904703b-975b-48dc-be71-a68e28ceb641 tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-5d141504-f87f-4cc1-833b-c453e88fc2be req-5904703b-975b-48dc-be71-a68e28ceb641 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-5d141504-f87f-4cc1-833b-c453e88fc2be req-5904703b-975b-48dc-be71-a68e28ceb641 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-5d141504-f87f-4cc1-833b-c453e88fc2be req-5904703b-975b-48dc-be71-a68e28ceb641 tempest-TestServerVolumeAttachmentScenario-765313996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-f80698d0-9081-4a30-8885-e519738bd675', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1cd1e21-8299-4c6e-b951-fddaf80b9ca9', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "cinder-da8545ad-96ff-45eb-9451-76eb978898da-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-da8545ad-96ff-45eb-9451-76eb978898da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "cinder-quobyte-13594390-c903-4eec-bc85-cbf99c9827d8" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-quobyte-13594390-c903-4eec-bc85-cbf99c9827d8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "cinder-quobyte-da8545ad-96ff-45eb-9451-76eb978898da" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-quobyte-da8545ad-96ff-45eb-9451-76eb978898da" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Deleting offline snapshot da8545ad-96ff-45eb-9451-76eb978898da of volume 13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] snapshot_file for this snap is: volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:49:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-5d141504-f87f-4cc1-833b-c453e88fc2be req-5904703b-975b-48dc-be71-a68e28ceb641 tempest-TestServerVolumeAttachmentScenario-765313996 None] attachment_update completed successfully. Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5094ab23-a42c-4f69-af36-107c602253ba]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:06 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da Nov 05 17:49:06 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:06 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da" returned: 0 in 0.484s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13594390-c903-4eec-bc85-cbf99c9827d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee992a0-cace-495a-b100-008d7847cc94]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Creating offline snapshot 06a3e61f-8f01-48de-a286-a21919415eea of volume efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a891241-84e4-4de2-b872-192c6a226b42]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:07 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 Nov 05 17:49:07 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:07 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba Nov 05 17:49:07 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:07 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8" returned: 0 in 0.439s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:07 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da Nov 05 17:49:07 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:07 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" returned: 0 in 0.436s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:07 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea 1G Nov 05 17:49:07 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:07 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:07 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da Nov 05 17:49:07 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:07 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea 1G" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:07 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea Nov 05 17:49:07 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:07 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8.da8545ad-96ff-45eb-9451-76eb978898da" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-quobyte-da8545ad-96ff-45eb-9451-76eb978898da" released by "_delete_snapshot" :: held 1.630s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-quobyte-13594390-c903-4eec-bc85-cbf99c9827d8" released by "delete_snapshot" :: held 1.654s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Created reservations ['dc822ece-eb4e-405e-abc5-d6190dc4f620', 'ac69d776-c464-4de3-b10c-c9b561806cb0', '87ac524d-1824-4c74-b044-c9cfe6db4780', '2cea9726-d3c5-4a71-b428-1fb602919b7a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Delete snapshot completed successfully. Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4e72e34b-e0ef-4ee1-97d8-2edf63fb302f tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-da8545ad-96ff-45eb-9451-76eb978898da-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:08 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea" returned: 0 in 0.311s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:08 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea is being set with open permissions: ugo+rw Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:08 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea Nov 05 17:49:08 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:08 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:08 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.info Nov 05 17:49:08 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "cinder-13594390-c903-4eec-bc85-cbf99c9827d8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-13594390-c903-4eec-bc85-cbf99c9827d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "cinder-quobyte-13594390-c903-4eec-bc85-cbf99c9827d8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-quobyte-13594390-c903-4eec-bc85-cbf99c9827d8" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b82cb-3d4e-4139-8a53-d9ce424865b0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:08 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.info" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:08 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.info is being set with open permissions: ugo+rw Nov 05 17:49:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:08 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.info Nov 05 17:49:08 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:08 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 Nov 05 17:49:08 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:09 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.info" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a5edcfbe-038c-4656-9067-d1bec4207336 tempest-CinderUnicodeTest-801617915 None] Create snapshot completed successfully Nov 05 17:49:09 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:09 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8 Nov 05 17:49:09 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:09 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-13594390-c903-4eec-bc85-cbf99c9827d8" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-quobyte-13594390-c903-4eec-bc85-cbf99c9827d8" released by "delete_volume" :: held 0.695s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Created reservations ['3ac6ee3c-fb5b-4c53-8fe6-148df1105cf2', 'fa5df898-f7fa-4063-be05-8eddb348e80b', '4a5bd58a-1aaf-4f3d-90a2-4238b2d7f49d', '718f6157-09db-4e84-8d6e-bcc9474bb5d6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:09 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:09 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:09 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Deleted volume successfully. Nov 05 17:49:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b4a1dffa-7ee7-4e90-8bca-ba8bad09eedf tempest-SnapshotMetadataTestJSON-1858291795 None] Lock "cinder-13594390-c903-4eec-bc85-cbf99c9827d8-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "cinder-06a3e61f-8f01-48de-a286-a21919415eea-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-06a3e61f-8f01-48de-a286-a21919415eea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "cinder-quobyte-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "cinder-quobyte-06a3e61f-8f01-48de-a286-a21919415eea" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-06a3e61f-8f01-48de-a286-a21919415eea" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Deleting offline snapshot 06a3e61f-8f01-48de-a286-a21919415eea of volume efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] snapshot_file for this snap is: volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00202fb-6d3c-4692-9ae3-8b4280904a15]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:10 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea Nov 05 17:49:10 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:10 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea" returned: 0 in 0.431s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac1ce0c-54ca-4c41-9917-cea4ed825f58]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:10 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba Nov 05 17:49:10 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:11 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" returned: 0 in 0.494s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:11 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea Nov 05 17:49:11 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-12853260-4b77-41f8-8fe8-19cb42c36105 req-dc265edb-e73d-473f-9f9c-4973264f848c tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-12853260-4b77-41f8-8fe8-19cb42c36105 req-dc265edb-e73d-473f-9f9c-4973264f848c tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-12853260-4b77-41f8-8fe8-19cb42c36105 req-dc265edb-e73d-473f-9f9c-4973264f848c tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-12853260-4b77-41f8-8fe8-19cb42c36105 req-dc265edb-e73d-473f-9f9c-4973264f848c tempest-TestServerVolumeAttachmentScenario-765313996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '897c6c95-10c6-4727-87a1-d2ccb62290e7', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:49:11 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-12853260-4b77-41f8-8fe8-19cb42c36105 req-dc265edb-e73d-473f-9f9c-4973264f848c tempest-TestServerVolumeAttachmentScenario-765313996 None] attachment_update completed successfully. Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:11 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea Nov 05 17:49:11 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:11 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba.06a3e61f-8f01-48de-a286-a21919415eea" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-06a3e61f-8f01-48de-a286-a21919415eea" released by "_delete_snapshot" :: held 1.755s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" released by "delete_snapshot" :: held 1.777s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Created reservations ['cb1346de-7f0b-42d3-b926-89a83984021b', 'dfeb6c9c-45de-42f3-a7a7-1bd6825d6171', '2f7a950a-acd3-4ac0-9b0a-c4ee3160b213', 'f3f34be1-b5f3-4de6-a7e6-34a31a64441c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Delete snapshot completed successfully. Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6bf2e09f-d29a-4a0a-b142-ea83e7b35b69 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-06a3e61f-8f01-48de-a286-a21919415eea-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Acquiring lock "cinder-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Lock "cinder-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Acquiring lock "cinder-quobyte-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dc5dee-5106-4103-bbae-5e352f406778]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:12 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba Nov 05 17:49:12 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:12 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" returned: 0 in 0.450s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:12 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba Nov 05 17:49:12 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-0bf81760-b811-4377-bfd6-5f4f16c356f7 req-bcd9b4ce-6765-4abd-b41f-ff14066b1d64 tempest-TestServerVolumeAttachmentScenario-765313996 None] Terminate volume connection completed successfully. Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-0bf81760-b811-4377-bfd6-5f4f16c356f7 req-bcd9b4ce-6765-4abd-b41f-ff14066b1d64 tempest-TestServerVolumeAttachmentScenario-765313996 None] Deleting attachment 897c6c95-10c6-4727-87a1-d2ccb62290e7. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:49:13 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba" released by "delete_volume" :: held 0.804s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Created reservations ['427b0e23-7fb2-47a5-8ecc-b3e6d0284d7a', '38cd59ba-3d91-42a7-b943-2a3e7e8b5a71', 'cbbf5ddd-8d5c-4d2b-b229-7f8295e58174', 'bc2d483a-7834-431f-9156-592000ddd35d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:13 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:13 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "cinder-17ca144a-d9e5-4635-bbba-1c5417f6bcd8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-17ca144a-d9e5-4635-bbba-1c5417f6bcd8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "cinder-quobyte-17ca144a-d9e5-4635-bbba-1c5417f6bcd8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-17ca144a-d9e5-4635-bbba-1c5417f6bcd8" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9220d7-7cb0-4df9-b5e9-cf7e361b368a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:13 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Deleted volume successfully. Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a68d62-7b76-4963-a176-93e25bc4526b tempest-CinderUnicodeTest-801617915 None] Lock "cinder-efcc7ed2-c19f-477d-bd0c-5b2f50e92fba-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:13 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 Nov 05 17:49:13 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:13 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:13 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:14 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8" returned: 0 in 0.434s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:14 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8 Nov 05 17:49:14 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:14 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:49:14 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-17ca144a-d9e5-4635-bbba-1c5417f6bcd8" returned: 0 in 0.337s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-quobyte-17ca144a-d9e5-4635-bbba-1c5417f6bcd8" released by "delete_volume" :: held 0.823s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Created reservations ['a1848e3f-094e-4c63-af63-28d2f5351c9f', '7d805981-df51-47c4-bb0c-7639f7938d2a', '73e77b4f-e9fa-43f9-9c5b-78af75a1dc4c', 'cd18b7f8-4ab1-4c98-bd80-a96de4eb56d6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:14 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:14 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-290dce1c-ee4e-4711-bbb6-abe49865e53c req-d5c0671d-b76d-4c0a-95d4-32a1ed8483cb tempest-TestServerVolumeAttachmentScenario-765313996 None] Terminate volume connection completed successfully. Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-290dce1c-ee4e-4711-bbb6-abe49865e53c req-d5c0671d-b76d-4c0a-95d4-32a1ed8483cb tempest-TestServerVolumeAttachmentScenario-765313996 None] Deleting attachment e1cd1e21-8299-4c6e-b951-fddaf80b9ca9. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:49:14 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.322s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Deleted volume successfully. Nov 05 17:49:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d64d7fb6-7434-4cc0-b0d8-c6b2ac45e7e9 tempest-CinderUnicodeTest-801617915 None] Lock "cinder-17ca144a-d9e5-4635-bbba-1c5417f6bcd8-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=152,cinder:INSERT=48,cinder:UPDATE=196,cinder:DELETE=11 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:INSERT=53,cinder:UPDATE=200,cinder:SELECT=153,cinder:DELETE=24 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Flow 'volume_create_manager' (c051db07-bab6-4f29-b01a-13a699816dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b730dc49-a8a2-482b-86b7-9048ebbf6e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b730dc49-a8a2-482b-86b7-9048ebbf6e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-461649475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0922fd5-d78d-4aed-80e4-55f416345f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469822b675b4720a716407470400494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:16Z,use_quota=True,user_id='6c86e16adb0940eaa78f095b483ec4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1ab51a-7918-4086-82b5-b90f15fd16e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1ab51a-7918-4086-82b5-b90f15fd16e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f61dd8-5f01-4716-9616-9aecfe1d4ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f61dd8-5f01-4716-9616-9aecfe1d4ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0922fd5-d78d-4aed-80e4-55f416345f21', 'volume_name': 'volume-c0922fd5-d78d-4aed-80e4-55f416345f21', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14add2a3-fb7b-4791-96d0-e9b70044ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14add2a3-fb7b-4791-96d0-e9b70044ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff02160c-b92c-423c-9412-584e70ae1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Volume c0922fd5-d78d-4aed-80e4-55f416345f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0922fd5-d78d-4aed-80e4-55f416345f21', 'volume_size': 1} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-461649475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0922fd5-d78d-4aed-80e4-55f416345f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469822b675b4720a716407470400494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:16Z,use_quota=True,user_id='6c86e16adb0940eaa78f095b483ec4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Creating volume c0922fd5-d78d-4aed-80e4-55f416345f21 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:16 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 1073741824 Nov 05 17:49:16 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:17 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 1073741824" returned: 0 in 0.605s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:17 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 Nov 05 17:49:17 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:17 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff02160c-b92c-423c-9412-584e70ae1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0922fd5-d78d-4aed-80e4-55f416345f21', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952ffada-3e59-4014-b9b4-14e342ae2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Volume volume-c0922fd5-d78d-4aed-80e4-55f416345f21 (c0922fd5-d78d-4aed-80e4-55f416345f21): created successfully Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952ffada-3e59-4014-b9b4-14e342ae2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Flow 'volume_create_manager' (c051db07-bab6-4f29-b01a-13a699816dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4474c25e-8507-44de-a30b-7370ac2738e3 tempest-VolumesTransfersV355Test-2079119886 None] Created volume successfully. Nov 05 17:49:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1e796718-165f-4cbf-b037-3dc8e5466d8a tempest-VolumesTransfersV355Test-1986022538 None] Transfer volume completed successfully. Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Flow 'volume_create_manager' (800b71e8-ab14-4065-a728-08ebbcc8d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d6351b-afbb-423f-9e8f-6531b8891cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d6351b-afbb-423f-9e8f-6531b8891cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401158996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a38a91-7b3e-474c-bd91-a32f9f2d4e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc4f05f68af444d81399d45980e3a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:19Z,use_quota=True,user_id='6b365609fea047c68fd0e639a0e4486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b58569-054e-496b-9baf-824b9be2f55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b58569-054e-496b-9baf-824b9be2f55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97c264c-d6bf-40bb-a1e8-dd06def94c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97c264c-d6bf-40bb-a1e8-dd06def94c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a38a91-7b3e-474c-bd91-a32f9f2d4e96', 'volume_name': 'volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5138b648-cf53-476c-a4fd-16c2b4f7feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5138b648-cf53-476c-a4fd-16c2b4f7feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229a4d4f-b06b-4f26-ac32-40a5b09671aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Volume 56a38a91-7b3e-474c-bd91-a32f9f2d4e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96', 'volume_size': 1} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401158996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a38a91-7b3e-474c-bd91-a32f9f2d4e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc4f05f68af444d81399d45980e3a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:19Z,use_quota=True,user_id='6b365609fea047c68fd0e639a0e4486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Creating volume 56a38a91-7b3e-474c-bd91-a32f9f2d4e96 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "cinder-54a9809f-c5a6-4c16-99e9-1e751e1d648d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:19 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 1073741824 Nov 05 17:49:19 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-54a9809f-c5a6-4c16-99e9-1e751e1d648d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "cinder-quobyte-54a9809f-c5a6-4c16-99e9-1e751e1d648d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-quobyte-54a9809f-c5a6-4c16-99e9-1e751e1d648d" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[531bdadd-ee82-4260-99e5-adbe09338bd4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:19 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d Nov 05 17:49:19 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Acquiring lock "cinder-c0922fd5-d78d-4aed-80e4-55f416345f21-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-c0922fd5-d78d-4aed-80e4-55f416345f21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Acquiring lock "cinder-quobyte-c0922fd5-d78d-4aed-80e4-55f416345f21" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-quobyte-c0922fd5-d78d-4aed-80e4-55f416345f21" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:20 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 1073741824" returned: 0 in 0.604s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:20 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3ae843-64f8-45d4-b0c7-6323afa8e62e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d" returned: 0 in 0.476s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:20 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d Nov 05 17:49:20 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:20 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 Nov 05 17:49:20 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:20 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 Nov 05 17:49:20 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:20 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-54a9809f-c5a6-4c16-99e9-1e751e1d648d" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-quobyte-54a9809f-c5a6-4c16-99e9-1e751e1d648d" released by "delete_volume" :: held 0.789s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:20 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96" returned: 0 in 0.293s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229a4d4f-b06b-4f26-ac32-40a5b09671aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a2a456-3198-4986-a51a-b96b84ef5c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Created reservations ['a624cb79-eaa7-4fc5-b9c7-ddeebfc41a67', '7f4fdf42-f693-429f-9de8-77a4748c3fb8', '1d7f2730-9c45-4f8c-b855-c6b64d4b3108', 'a04e6d2e-98f8-4bb0-a361-86ff750bc72a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Volume volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 (56a38a91-7b3e-474c-bd91-a32f9f2d4e96): created successfully Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a2a456-3198-4986-a51a-b96b84ef5c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Flow 'volume_create_manager' (800b71e8-ab14-4065-a728-08ebbcc8d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:20 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ad6ec0cb-1112-4583-8691-8e9d08dd4215 tempest-ProjectReaderTests-281036763 None] Created volume successfully. Nov 05 17:49:20 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21 Nov 05 17:49:20 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:20 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:20 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "cinder-f80698d0-9081-4a30-8885-e519738bd675-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-f80698d0-9081-4a30-8885-e519738bd675-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "cinder-quobyte-f80698d0-9081-4a30-8885-e519738bd675" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-quobyte-f80698d0-9081-4a30-8885-e519738bd675" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:21 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c54e03-457f-4bbd-9b4b-28437d0cb19b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c0922fd5-d78d-4aed-80e4-55f416345f21" returned: 0 in 0.332s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-quobyte-c0922fd5-d78d-4aed-80e4-55f416345f21" released by "delete_volume" :: held 0.794s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:21 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.325s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Deleted volume successfully. Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Created reservations ['8e6b324b-aff1-4088-8b32-52906d5ec9de', '5d065b06-abb3-4fde-896d-6289416b1179', '2dd2ccc7-8f6e-4380-b65d-8325c9757366', 'c583bbf5-f87e-4847-8ceb-4b8b5e01eb5d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c3538a4a-2b66-47e2-b9f7-ec080b845c6a tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-54a9809f-c5a6-4c16-99e9-1e751e1d648d-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:21 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 Nov 05 17:49:21 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:21 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:21 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:21 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:21 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675 Nov 05 17:49:21 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:21 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Deleted volume successfully. Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23f553ea-9409-4eae-9207-311702d6fe90 tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-c0922fd5-d78d-4aed-80e4-55f416345f21-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:21 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f80698d0-9081-4a30-8885-e519738bd675" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-quobyte-f80698d0-9081-4a30-8885-e519738bd675" released by "delete_volume" :: held 0.742s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Acquiring lock "cinder-56a38a91-7b3e-474c-bd91-a32f9f2d4e96-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Lock "cinder-56a38a91-7b3e-474c-bd91-a32f9f2d4e96-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Created reservations ['e07e6067-ba04-4105-bed8-ebccd2529fba', '3b72e119-e46f-44fc-bdfd-4d4befbe7889', '62e40148-a7de-4472-b470-4ea65e3afa0d', '35ca5306-1608-45de-a87d-a2902cc2c4ec'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Acquiring lock "cinder-quobyte-56a38a91-7b3e-474c-bd91-a32f9f2d4e96" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Lock "cinder-quobyte-56a38a91-7b3e-474c-bd91-a32f9f2d4e96" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[491d1b66-d005-4f8f-8f99-1648ac8ff7bc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:22 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:22 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Flow 'volume_create_manager' (be223c9a-009a-4ec4-b9a8-ee0dc4f7e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88091d29-8df1-445d-8178-8657aa26788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88091d29-8df1-445d-8178-8657aa26788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-943644692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe35851-f8ee-4364-b298-db162c52f264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469822b675b4720a716407470400494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:22Z,use_quota=True,user_id='6c86e16adb0940eaa78f095b483ec4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d94dc5-4d06-4548-8930-0af5d4eace9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d94dc5-4d06-4548-8930-0af5d4eace9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3458d572-fb24-4f32-ad9c-4983c562bd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3458d572-fb24-4f32-ad9c-4983c562bd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe35851-f8ee-4364-b298-db162c52f264', 'volume_name': 'volume-dfe35851-f8ee-4364-b298-db162c52f264', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484c63e-1d9f-4d97-8f09-ada2bcc5bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484c63e-1d9f-4d97-8f09-ada2bcc5bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfc6147-804c-4379-8727-cbfcacf0b535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Volume dfe35851-f8ee-4364-b298-db162c52f264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe35851-f8ee-4364-b298-db162c52f264', 'volume_size': 1} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-943644692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe35851-f8ee-4364-b298-db162c52f264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469822b675b4720a716407470400494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:22Z,use_quota=True,user_id='6c86e16adb0940eaa78f095b483ec4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Creating volume dfe35851-f8ee-4364-b298-db162c52f264 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:22 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 Nov 05 17:49:22 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:22 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:22 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 1073741824 Nov 05 17:49:22 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:22 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Deleted volume successfully. Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-517acdf7-5ef5-4df3-88be-735916dd3d68 tempest-TestServerVolumeAttachmentScenario-765313996 None] Lock "cinder-f80698d0-9081-4a30-8885-e519738bd675-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:22 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96" returned: 0 in 0.452s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:22 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96 Nov 05 17:49:22 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:22 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 1073741824" returned: 0 in 0.482s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:22 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 Nov 05 17:49:22 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:22 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56a38a91-7b3e-474c-bd91-a32f9f2d4e96" returned: 0 in 0.295s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Lock "cinder-quobyte-56a38a91-7b3e-474c-bd91-a32f9f2d4e96" released by "delete_volume" :: held 0.803s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Created reservations ['8ed88239-86d0-452b-939b-df4925d83eeb', '0a69822f-c017-4081-90a4-6745b79f2385', '5bc39911-c202-4e65-a534-f3ea649e4714', '74812e6b-a757-4801-bbb2-cebcd8106929'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:22 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:22 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:22 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfc6147-804c-4379-8727-cbfcacf0b535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe35851-f8ee-4364-b298-db162c52f264', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fccee98-7b7e-4a35-8bc5-eb2875703dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Volume volume-dfe35851-f8ee-4364-b298-db162c52f264 (dfe35851-f8ee-4364-b298-db162c52f264): created successfully Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fccee98-7b7e-4a35-8bc5-eb2875703dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Flow 'volume_create_manager' (be223c9a-009a-4ec4-b9a8-ee0dc4f7e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-91eb5a64-623e-4644-b3a8-648fcd4a42fd tempest-VolumesTransfersV355Test-2079119886 None] Created volume successfully. Nov 05 17:49:23 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.331s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Deleted volume successfully. Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e82e329e-5918-4665-ae69-228871b0677f tempest-ProjectReaderTests-281036763 None] Lock "cinder-56a38a91-7b3e-474c-bd91-a32f9f2d4e96-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Flow 'volume_create_manager' (bb8df60c-57aa-4104-a728-91a85fdc801d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb019cf-936f-4a7a-bf73-b7a33a60a11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb019cf-936f-4a7a-bf73-b7a33a60a11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712070143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f90b78-b109-46ee-872a-a494cdb8c19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc4f05f68af444d81399d45980e3a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:23Z,use_quota=True,user_id='6b365609fea047c68fd0e639a0e4486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e77520-d37f-49b5-a236-ed90958d0085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e77520-d37f-49b5-a236-ed90958d0085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d0982a-8ccc-4488-a0ed-3484cce2290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d0982a-8ccc-4488-a0ed-3484cce2290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f90b78-b109-46ee-872a-a494cdb8c19f', 'volume_name': 'volume-b8f90b78-b109-46ee-872a-a494cdb8c19f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b86cc8-63e6-4c80-b6da-5b5fd6c8287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b86cc8-63e6-4c80-b6da-5b5fd6c8287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56a4101-2737-457b-ab7d-3a4bc2617e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Volume b8f90b78-b109-46ee-872a-a494cdb8c19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f90b78-b109-46ee-872a-a494cdb8c19f', 'volume_size': 1} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712070143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f90b78-b109-46ee-872a-a494cdb8c19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc4f05f68af444d81399d45980e3a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:23Z,use_quota=True,user_id='6b365609fea047c68fd0e639a0e4486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Creating volume b8f90b78-b109-46ee-872a-a494cdb8c19f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:23 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:23 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f 1073741824 Nov 05 17:49:23 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:24 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f 1073741824" returned: 0 in 0.510s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:24 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f Nov 05 17:49:24 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Acquiring lock "cinder-dfe35851-f8ee-4364-b298-db162c52f264-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-dfe35851-f8ee-4364-b298-db162c52f264-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:24 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Acquiring lock "cinder-quobyte-dfe35851-f8ee-4364-b298-db162c52f264" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-quobyte-dfe35851-f8ee-4364-b298-db162c52f264" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56a4101-2737-457b-ab7d-3a4bc2617e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f90b78-b109-46ee-872a-a494cdb8c19f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0f0060-60de-4c16-886f-3dd6cb7cda54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf059c24-8c03-4db2-9f5b-163637943a0f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Volume volume-b8f90b78-b109-46ee-872a-a494cdb8c19f (b8f90b78-b109-46ee-872a-a494cdb8c19f): created successfully Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0f0060-60de-4c16-886f-3dd6cb7cda54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Flow 'volume_create_manager' (bb8df60c-57aa-4104-a728-91a85fdc801d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-75961ab1-681f-4afe-85b8-dbd95f80c3a7 tempest-ProjectReaderTests-281036763 None] Created volume successfully. Nov 05 17:49:24 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 Nov 05 17:49:24 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:25 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264" returned: 0 in 0.453s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:25 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264 Nov 05 17:49:25 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:25 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-dfe35851-f8ee-4364-b298-db162c52f264" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-quobyte-dfe35851-f8ee-4364-b298-db162c52f264" released by "delete_volume" :: held 0.753s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Created reservations ['7b2add1d-5473-4e95-9b80-1d7860f9b1bd', 'a34aa246-a347-4d6d-9a3c-b9eb0f7b4377', 'a8cb35b6-ebdb-4ee2-9e80-045a1231b2e5', '1d23fa9b-5401-48fe-aedd-9c86d9543494'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:25 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:25 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:25 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Acquiring lock "cinder-b8f90b78-b109-46ee-872a-a494cdb8c19f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Deleted volume successfully. Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Lock "cinder-b8f90b78-b109-46ee-872a-a494cdb8c19f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-264389a2-376c-4bf5-9e3e-23c63d73e16a tempest-VolumesTransfersV355Test-1359854112 None] Lock "cinder-dfe35851-f8ee-4364-b298-db162c52f264-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Acquiring lock "cinder-quobyte-b8f90b78-b109-46ee-872a-a494cdb8c19f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Lock "cinder-quobyte-b8f90b78-b109-46ee-872a-a494cdb8c19f" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[653386fc-63a3-4c45-a26f-90099ae61975]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:26 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f Nov 05 17:49:26 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:26 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f" returned: 0 in 0.488s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:26 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f Nov 05 17:49:26 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:26 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b8f90b78-b109-46ee-872a-a494cdb8c19f" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Lock "cinder-quobyte-b8f90b78-b109-46ee-872a-a494cdb8c19f" released by "delete_volume" :: held 0.827s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Created reservations ['0113f1f3-f9d9-4288-9194-b9e603c4c4f0', '0840c8fb-41de-46f3-ba2b-bf48ab62808f', '79bc6351-6641-4715-92fa-e2b0a4b8bd75', 'b994c7c0-8321-4a24-a21e-ada750d94d04'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:26 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:26 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:27 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:27 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Deleted volume successfully. Nov 05 17:49:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2e95346-6cca-4467-ae86-0f00fd568dad tempest-ProjectReaderTests-281036763 None] Lock "cinder-b8f90b78-b109-46ee-872a-a494cdb8c19f-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Flow 'volume_create_manager' (ad2f7e5f-c84a-4545-bc34-bb609ab6a7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b105ec4b-54fa-418d-97b3-1aff58a97887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b105ec4b-54fa-418d-97b3-1aff58a97887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-324840231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b5ba32-4975-441e-a67d-7b3a7710dcaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815c0b645c7e4a31921817a1d471deb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:35Z,use_quota=True,user_id='810e4ffe71584d9fa2fbce6014d92a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a6ad75-9476-42c5-97f1-d2829e20cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a6ad75-9476-42c5-97f1-d2829e20cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994de9a9-ea8e-46cc-bb5e-7b93282da3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994de9a9-ea8e-46cc-bb5e-7b93282da3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b5ba32-4975-441e-a67d-7b3a7710dcaa', 'volume_name': 'volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07364df1-f515-425b-ac9f-43633011c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07364df1-f515-425b-ac9f-43633011c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cccadf2-5b2f-4b1a-90fa-eaca4412ded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Volume 45b5ba32-4975-441e-a67d-7b3a7710dcaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa', 'volume_size': 1} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-324840231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b5ba32-4975-441e-a67d-7b3a7710dcaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815c0b645c7e4a31921817a1d471deb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:35Z,use_quota=True,user_id='810e4ffe71584d9fa2fbce6014d92a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Creating volume 45b5ba32-4975-441e-a67d-7b3a7710dcaa {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:35 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa 1073741824 Nov 05 17:49:35 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:35 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa 1073741824" returned: 0 in 0.495s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:35 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa Nov 05 17:49:35 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:36 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa" returned: 0 in 0.351s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cccadf2-5b2f-4b1a-90fa-eaca4412ded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61886b60-49cb-4327-a4d4-dfb5511891e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Volume volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa (45b5ba32-4975-441e-a67d-7b3a7710dcaa): created successfully Nov 05 17:49:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61886b60-49cb-4327-a4d4-dfb5511891e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Flow 'volume_create_manager' (ad2f7e5f-c84a-4545-bc34-bb609ab6a7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-95e814a4-8dc4-4414-8bb0-3555c07becb5 tempest-VolumesTransfersV357Test-665651120 None] Created volume successfully. Nov 05 17:49:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3792994e-09f4-4534-b50b-b9c86d9e33ac tempest-VolumesTransfersV357Test-624324133 None] Transfer volume completed successfully. Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Acquiring lock "cinder-45b5ba32-4975-441e-a67d-7b3a7710dcaa-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-45b5ba32-4975-441e-a67d-7b3a7710dcaa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Acquiring lock "cinder-quobyte-45b5ba32-4975-441e-a67d-7b3a7710dcaa" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-quobyte-45b5ba32-4975-441e-a67d-7b3a7710dcaa" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6bca78-5369-49eb-84a9-0767a209a1d4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:38 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa Nov 05 17:49:38 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:38 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:38 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa Nov 05 17:49:38 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:39 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-45b5ba32-4975-441e-a67d-7b3a7710dcaa" returned: 0 in 0.343s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-quobyte-45b5ba32-4975-441e-a67d-7b3a7710dcaa" released by "delete_volume" :: held 0.789s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Created reservations ['02fc0440-9606-4b4f-9399-63f1222c96fe', '3ea275bd-690c-421a-8d28-94e780afddd8', 'a681c587-29a9-4206-8f3c-b2fd56a97b63', 'f063648b-b34a-46be-bd7b-243fce28a6b2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:39 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:39 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:39 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Deleted volume successfully. Nov 05 17:49:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc0099ef-5be2-443d-8c29-17a6b3cc4569 tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-45b5ba32-4975-441e-a67d-7b3a7710dcaa-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Flow 'volume_create_manager' (32d664e5-2a5f-49f0-bbdd-3aa049aed59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4320d6f1-de07-4851-ad63-1563ec35821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4320d6f1-de07-4851-ad63-1563ec35821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1256034265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279c0b2-dcdb-42e4-83a7-4f66e41a7dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815c0b645c7e4a31921817a1d471deb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:40Z,use_quota=True,user_id='810e4ffe71584d9fa2fbce6014d92a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb66a08-475a-43e0-821b-5425a929938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb66a08-475a-43e0-821b-5425a929938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e57c03b-a279-407c-b097-16e151457c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e57c03b-a279-407c-b097-16e151457c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8279c0b2-dcdb-42e4-83a7-4f66e41a7dba', 'volume_name': 'volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a753c4b5-4b58-46b3-9b07-caf759057b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a753c4b5-4b58-46b3-9b07-caf759057b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9ddb76-e46b-4a7c-b241-069ee15b1e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Volume 8279c0b2-dcdb-42e4-83a7-4f66e41a7dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba', 'volume_size': 1} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1256034265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279c0b2-dcdb-42e4-83a7-4f66e41a7dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815c0b645c7e4a31921817a1d471deb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:40Z,use_quota=True,user_id='810e4ffe71584d9fa2fbce6014d92a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Creating volume 8279c0b2-dcdb-42e4-83a7-4f66e41a7dba {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:40 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba 1073741824 Nov 05 17:49:40 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:40 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba 1073741824" returned: 0 in 0.525s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:40 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba Nov 05 17:49:40 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:41 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba" returned: 0 in 0.286s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9ddb76-e46b-4a7c-b241-069ee15b1e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094acd3b-032e-44c2-ab94-ed3ebf4662aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Volume volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba (8279c0b2-dcdb-42e4-83a7-4f66e41a7dba): created successfully Nov 05 17:49:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094acd3b-032e-44c2-ab94-ed3ebf4662aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Flow 'volume_create_manager' (32d664e5-2a5f-49f0-bbdd-3aa049aed59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-936daaa2-00ae-455b-abaa-5cd75c5efbfc tempest-VolumesTransfersV357Test-665651120 None] Created volume successfully. Nov 05 17:49:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Acquiring lock "cinder-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Acquiring lock "cinder-quobyte-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-quobyte-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[31496aa0-4af4-454c-a3bc-469b06ded1a0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:42 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba Nov 05 17:49:42 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:43 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:43 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba Nov 05 17:49:43 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:43 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-quobyte-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba" released by "delete_volume" :: held 0.680s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Created reservations ['8aafb4eb-49ad-4d1f-8b11-0aba543f4679', '0b29b309-ec98-4383-8bc8-8486ecb8372b', 'e721b74c-5e4a-434f-b0c6-9ac13f781c7a', 'fc269cad-328d-4213-bf7e-0ce5e422dc8d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:43 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:43 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:43 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Deleted volume successfully. Nov 05 17:49:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-360482b0-00ae-47af-a947-31cca91a896e tempest-VolumesTransfersV357Test-1499424701 None] Lock "cinder-8279c0b2-dcdb-42e4-83a7-4f66e41a7dba-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Flow 'volume_create_manager' (c9640916-1988-4bda-81ee-78bb0897dee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08358b2-41d8-4408-89e1-d2dd6a980364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08358b2-41d8-4408-89e1-d2dd6a980364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1532156750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2726b67-a0ff-46d5-bc15-80adb8958cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7e45559b674d7ea75d418d9a7668c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:50Z,use_quota=True,user_id='7d0294d5583c4d9ebbdbfb2640fc545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f70b645-a029-47be-a808-ec28cf69038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f70b645-a029-47be-a808-ec28cf69038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a4fe3f-a8e7-4250-8efe-95dd714b88aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a4fe3f-a8e7-4250-8efe-95dd714b88aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2726b67-a0ff-46d5-bc15-80adb8958cde', 'volume_name': 'volume-d2726b67-a0ff-46d5-bc15-80adb8958cde', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a69f580-0c98-477c-9d49-0924d892960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a69f580-0c98-477c-9d49-0924d892960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0388a65-1797-4711-8117-783463386dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Volume d2726b67-a0ff-46d5-bc15-80adb8958cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2726b67-a0ff-46d5-bc15-80adb8958cde', 'volume_size': 2} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1532156750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2726b67-a0ff-46d5-bc15-80adb8958cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7e45559b674d7ea75d418d9a7668c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:50Z,use_quota=True,user_id='7d0294d5583c4d9ebbdbfb2640fc545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Creating volume d2726b67-a0ff-46d5-bc15-80adb8958cde {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:50 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde 2147483648 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:50 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde 2147483648 Nov 05 17:49:50 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:51 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde 2147483648" returned: 0 in 0.635s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:51 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde Nov 05 17:49:51 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:51 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde" returned: 0 in 0.275s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0388a65-1797-4711-8117-783463386dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2726b67-a0ff-46d5-bc15-80adb8958cde', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc745c83-993f-480a-99af-629b09b8a124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Volume volume-d2726b67-a0ff-46d5-bc15-80adb8958cde (d2726b67-a0ff-46d5-bc15-80adb8958cde): created successfully Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc745c83-993f-480a-99af-629b09b8a124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Flow 'volume_create_manager' (c9640916-1988-4bda-81ee-78bb0897dee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8a693830-11d3-4d8b-b172-4cb4efa06668 tempest-VolumesCloneNegativeTest-794196557 None] Created volume successfully. Nov 05 17:49:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Acquiring lock "cinder-d2726b67-a0ff-46d5-bc15-80adb8958cde-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Lock "cinder-d2726b67-a0ff-46d5-bc15-80adb8958cde-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Acquiring lock "cinder-quobyte-d2726b67-a0ff-46d5-bc15-80adb8958cde" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:49:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Lock "cinder-quobyte-d2726b67-a0ff-46d5-bc15-80adb8958cde" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:49:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a56b44-128a-4eec-8e4f-ea073a998192]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:49:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:52 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde Nov 05 17:49:52 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:53 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:53 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde Nov 05 17:49:53 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:53 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d2726b67-a0ff-46d5-bc15-80adb8958cde" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Lock "cinder-quobyte-d2726b67-a0ff-46d5-bc15-80adb8958cde" released by "delete_volume" :: held 0.794s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Created reservations ['cd6fbb10-72bd-46f1-8148-a330afced273', 'ee49facd-4d79-4c7f-a53a-8f08b5393c86', 'f33e78c7-e773-477e-9a03-b4fba78dd493', '158467d0-7cd5-45d9-9936-638cbb734d36'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:53 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:49:53 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:53 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:49:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Deleted volume successfully. Nov 05 17:49:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fc7dd0fd-dc2d-470c-baa3-8cefa45fa787 tempest-VolumesCloneNegativeTest-794196557 None] Lock "cinder-d2726b67-a0ff-46d5-bc15-80adb8958cde-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Flow 'volume_create_manager' (63666ea3-6bbc-4d31-9eec-b54810918166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a34494-780e-44c1-bd40-7122b8186cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a34494-780e-44c1-bd40-7122b8186cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-694502899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba8ad7-5fa4-4502-aeea-2654f870f56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0113336746dc41a0a6d7795c1089c732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:57Z,use_quota=True,user_id='e4a50670509b405aa74d5805a92dd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a153104e-ca6c-4783-9ce4-9d5bbd68640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a153104e-ca6c-4783-9ce4-9d5bbd68640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f634105-11d7-4ce7-a08d-2fde26015b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f634105-11d7-4ce7-a08d-2fde26015b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fba8ad7-5fa4-4502-aeea-2654f870f56f', 'volume_name': 'volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38693a02-aff2-449a-9aad-8a5be7285a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38693a02-aff2-449a-9aad-8a5be7285a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b175e2e6-a95a-4070-abd9-0e9efe486bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Volume 7fba8ad7-5fa4-4502-aeea-2654f870f56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f', 'volume_size': 1} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-694502899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba8ad7-5fa4-4502-aeea-2654f870f56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0113336746dc41a0a6d7795c1089c732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:57Z,use_quota=True,user_id='e4a50670509b405aa74d5805a92dd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Creating volume 7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:57 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f 1073741824 Nov 05 17:49:57 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:57 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f 1073741824" returned: 0 in 0.545s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Flow 'volume_create_manager' (44e80081-8834-40ad-8ed4-7f17eef30c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2378e1-e743-4ce6-b51a-4a0e8c67347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2378e1-e743-4ce6-b51a-4a0e8c67347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1491219129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb9e4e5-1cd1-4045-93e4-95f346897830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95eeab371b4f4b9f96516f26a88be365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:58Z,use_quota=True,user_id='182d619e38484066a8e517822457a36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bcd02c-aa96-4b99-9c91-078650166c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bcd02c-aa96-4b99-9c91-078650166c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fe96ec-60c7-435e-ab95-571595d3cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fe96ec-60c7-435e-ab95-571595d3cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb9e4e5-1cd1-4045-93e4-95f346897830', 'volume_name': 'volume-5eb9e4e5-1cd1-4045-93e4-95f346897830', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c57c8ca-62ec-40cf-bfbb-328df8fc4f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c57c8ca-62ec-40cf-bfbb-328df8fc4f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f9c898-b68b-42e4-a823-2137b83d9d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Volume 5eb9e4e5-1cd1-4045-93e4-95f346897830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb9e4e5-1cd1-4045-93e4-95f346897830', 'volume_size': 1} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:57 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f Nov 05 17:49:57 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:58 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1491219129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb9e4e5-1cd1-4045-93e4-95f346897830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95eeab371b4f4b9f96516f26a88be365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:49:58Z,use_quota=True,user_id='182d619e38484066a8e517822457a36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Creating volume 5eb9e4e5-1cd1-4045-93e4-95f346897830 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:49:58 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b175e2e6-a95a-4070-abd9-0e9efe486bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:58 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 1073741824 Nov 05 17:49:58 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab80afb-ae14-418e-869e-8955367f9df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Volume volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f (7fba8ad7-5fa4-4502-aeea-2654f870f56f): created successfully Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab80afb-ae14-418e-869e-8955367f9df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Flow 'volume_create_manager' (63666ea3-6bbc-4d31-9eec-b54810918166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1a9ba4a3-b90c-48df-a14e-83dc8eabf2c2 tempest-TestStampPattern-913414584 None] Created volume successfully. Nov 05 17:49:58 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 1073741824" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:49:58 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 Nov 05 17:49:58 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:49:58 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f9c898-b68b-42e4-a823-2137b83d9d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb9e4e5-1cd1-4045-93e4-95f346897830', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e0c33d-c168-4260-af1a-22fb923cc361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:49:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Volume volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 (5eb9e4e5-1cd1-4045-93e4-95f346897830): created successfully Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e0c33d-c168-4260-af1a-22fb923cc361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:49:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Flow 'volume_create_manager' (44e80081-8834-40ad-8ed4-7f17eef30c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:49:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d2785f01-f4f9-4beb-912a-56f2a2baef1d tempest-VolumesNegativeTest-1205796194 None] Created volume successfully. Nov 05 17:50:08 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=63,cinder:UPDATE=110,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:50:08 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=64,cinder:INSERT=22,cinder:UPDATE=87,cinder:DELETE=11 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:50:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:50:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:13 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:50:13 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:14 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.275s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:50:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:50:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:50:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:50:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Acquiring lock "cinder-5eb9e4e5-1cd1-4045-93e4-95f346897830-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Lock "cinder-5eb9e4e5-1cd1-4045-93e4-95f346897830-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Acquiring lock "cinder-quobyte-5eb9e4e5-1cd1-4045-93e4-95f346897830" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Lock "cinder-quobyte-5eb9e4e5-1cd1-4045-93e4-95f346897830" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c18ee-ab80-44c6-9fe2-cae656a69760]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:17 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 Nov 05 17:50:17 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:18 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:18 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830 Nov 05 17:50:18 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:18 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5eb9e4e5-1cd1-4045-93e4-95f346897830" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Lock "cinder-quobyte-5eb9e4e5-1cd1-4045-93e4-95f346897830" released by "delete_volume" :: held 0.622s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Created reservations ['91f60835-11a0-4c86-8f6d-1a56a6079230', 'e2d4dfbf-229f-4429-ade1-63dae41510b0', 'e9efab3a-62a6-4bdc-81b5-a5896671e879', 'de685cb1-afc7-4319-9624-50a8e7748252'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:18 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:50:18 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:18 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.237s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:50:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Deleted volume successfully. Nov 05 17:50:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5c05971-203e-439d-bb8a-6f2d4ca7de41 tempest-VolumesNegativeTest-1205796194 None] Lock "cinder-5eb9e4e5-1cd1-4045-93e4-95f346897830-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:28 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:50:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4b7bea65-1dda-4119-9ed9-0e8ac6db0d08 req-b337f94c-d02a-4c26-b125-f0390ae1bf3d tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4b7bea65-1dda-4119-9ed9-0e8ac6db0d08 req-b337f94c-d02a-4c26-b125-f0390ae1bf3d tempest-TestStampPattern-913414584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4b7bea65-1dda-4119-9ed9-0e8ac6db0d08 req-b337f94c-d02a-4c26-b125-f0390ae1bf3d tempest-TestStampPattern-913414584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-4b7bea65-1dda-4119-9ed9-0e8ac6db0d08 req-b337f94c-d02a-4c26-b125-f0390ae1bf3d tempest-TestStampPattern-913414584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7f6d741-445f-4fb7-92cf-6c5bb589d9c8', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:50:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-4b7bea65-1dda-4119-9ed9-0e8ac6db0d08 req-b337f94c-d02a-4c26-b125-f0390ae1bf3d tempest-TestStampPattern-913414584 None] attachment_update completed successfully. Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (cc07cb0c-d28a-429c-9ae0-e9926c977423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3601174f-5f8d-4fdf-bf14-144c3142c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3601174f-5f8d-4fdf-bf14-144c3142c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-240969290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8dad5f-e8f6-443c-922e-f7f75409741e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:50:32Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a77825d-f45b-4484-b200-780f7a11ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a77825d-f45b-4484-b200-780f7a11ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5794c4ac-36bd-4d20-bc15-eea9702fa1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5794c4ac-36bd-4d20-bc15-eea9702fa1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8dad5f-e8f6-443c-922e-f7f75409741e', 'volume_name': 'volume-1e8dad5f-e8f6-443c-922e-f7f75409741e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db7ae4b-cd69-4b31-9dad-6f49b72414ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db7ae4b-cd69-4b31-9dad-6f49b72414ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f791c162-6fab-4e43-86a2-8bdb5dec6237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Volume 1e8dad5f-e8f6-443c-922e-f7f75409741e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8dad5f-e8f6-443c-922e-f7f75409741e', 'volume_size': 1} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-240969290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8dad5f-e8f6-443c-922e-f7f75409741e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:50:32Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Creating volume 1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:50:31 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:50:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:31 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e 1073741824 Nov 05 17:50:31 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:32 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e 1073741824" returned: 0 in 0.428s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:32 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e Nov 05 17:50:32 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:32 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f791c162-6fab-4e43-86a2-8bdb5dec6237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8dad5f-e8f6-443c-922e-f7f75409741e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4e2046-ff47-4c20-87d4-842f8424526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Volume volume-1e8dad5f-e8f6-443c-922e-f7f75409741e (1e8dad5f-e8f6-443c-922e-f7f75409741e): created successfully Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4e2046-ff47-4c20-87d4-842f8424526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (cc07cb0c-d28a-429c-9ae0-e9926c977423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:50:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-28f9a5e5-4eea-4be9-a7e0-3709755589f8 tempest-VolumesSnapshotTestJSON-407803813 None] Created volume successfully. Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Creating offline snapshot b14771e2-0d89-444c-841c-80921caa2bda of volume 1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:50:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0baa5ba-c65b-408b-b9f8-5658afab476e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:33 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e Nov 05 17:50:33 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:33 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:33 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda 1G Nov 05 17:50:33 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:33 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda 1G" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e8dad5f-e8f6-443c-922e-f7f75409741e -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:33 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e8dad5f-e8f6-443c-922e-f7f75409741e -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda Nov 05 17:50:33 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:34 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e8dad5f-e8f6-443c-922e-f7f75409741e -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:34 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda is being set with open permissions: ugo+rw Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:34 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda Nov 05 17:50:34 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:34 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:34 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.info Nov 05 17:50:34 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-bd6dda8b-d090-4d03-ad5f-e04cf7057753 req-f7f055f8-ef89-4826-944a-8f3e5772a5b1 tempest-TestStampPattern-913414584 None] Terminate volume connection completed successfully. Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-bd6dda8b-d090-4d03-ad5f-e04cf7057753 req-f7f055f8-ef89-4826-944a-8f3e5772a5b1 tempest-TestStampPattern-913414584 None] Deleting attachment a7f6d741-445f-4fb7-92cf-6c5bb589d9c8. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:50:34 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.info" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:34 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.info is being set with open permissions: ugo+rw Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:34 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.info Nov 05 17:50:34 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:34 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.info" returned: 0 in 0.234s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c3a81c6f-74ac-41e8-b5e1-d99a0d29ea96 tempest-VolumesSnapshotTestJSON-407803813 None] Create snapshot completed successfully Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-b14771e2-0d89-444c-841c-80921caa2bda-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-b14771e2-0d89-444c-841c-80921caa2bda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-1e8dad5f-e8f6-443c-922e-f7f75409741e" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1e8dad5f-e8f6-443c-922e-f7f75409741e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-b14771e2-0d89-444c-841c-80921caa2bda" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-b14771e2-0d89-444c-841c-80921caa2bda" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Deleting offline snapshot b14771e2-0d89-444c-841c-80921caa2bda of volume 1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] snapshot_file for this snap is: volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[245aca3b-64cb-4b2a-94b0-7d1a33c712e4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:35 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda Nov 05 17:50:35 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Creating offline snapshot a1ac330b-5583-474b-8ad7-771bdaa14c4a of volume 7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d09eac-04f8-4b5d-b89a-3576e36f6c9a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:35 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f Nov 05 17:50:35 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:35 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda" returned: 0 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e8dad5f-e8f6-443c-922e-f7f75409741e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb6a1b-3a8e-45f2-b394-f1ab45902cd2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:35 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e Nov 05 17:50:35 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:35 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:35 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a 1G Nov 05 17:50:35 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:36 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e" returned: 0 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:36 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda Nov 05 17:50:36 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:36 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a 1G" returned: 0 in 0.435s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:36 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a Nov 05 17:50:36 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:36 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:36 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda Nov 05 17:50:36 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:36 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a" returned: 0 in 0.286s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:36 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a is being set with open permissions: ugo+rw Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:36 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a Nov 05 17:50:36 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:36 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e.b14771e2-0d89-444c-841c-80921caa2bda" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-b14771e2-0d89-444c-841c-80921caa2bda" released by "_delete_snapshot" :: held 1.445s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1e8dad5f-e8f6-443c-922e-f7f75409741e" released by "delete_snapshot" :: held 1.466s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['798a8d4d-a81e-464e-8ae5-8d2ff8fbfeb6', '8e952d27-02b5-45ad-acfe-15ff7d66fb6c', '137df77e-3a65-4c39-b352-e60d7ccea945', 'a9ddf67b-c8bb-4235-84cb-0eb25bd581a6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:50:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Delete snapshot completed successfully. Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ffe44c7-8843-443d-9ade-6d347fcacf0e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-b14771e2-0d89-444c-841c-80921caa2bda-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:36 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:36 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.info Nov 05 17:50:36 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:37 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.info" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:37 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.info is being set with open permissions: ugo+rw Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:37 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.info Nov 05 17:50:37 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:37 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.info" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d780135e-e2c3-4ba2-832a-e65173c80fa7 tempest-TestStampPattern-913414584 None] Create snapshot completed successfully Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (c7ff5600-73b8-434d-beef-7df2ef045005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a2d180-ff49-4116-b03e-12f8ac56e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a2d180-ff49-4116-b03e-12f8ac56e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2125324013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71c8ae2-e069-41d6-8d99-7e53e9c42583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:50:38Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d799ba34-186f-4804-b984-b4f24ba44465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d799ba34-186f-4804-b984-b4f24ba44465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb357b0-d704-47fa-a2f4-435b8e0706a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb357b0-d704-47fa-a2f4-435b8e0706a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71c8ae2-e069-41d6-8d99-7e53e9c42583', 'volume_name': 'volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b21ca0-b8db-4ece-9a61-cd433f6a45de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b21ca0-b8db-4ece-9a61-cd433f6a45de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb83c3b-9cec-4959-8486-51fe6f1a348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Volume c71c8ae2-e069-41d6-8d99-7e53e9c42583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583', 'volume_size': 1} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2125324013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71c8ae2-e069-41d6-8d99-7e53e9c42583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:50:38Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Creating volume c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:50:37 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:50:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:37 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 1073741824 Nov 05 17:50:37 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:38 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 1073741824" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:38 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 Nov 05 17:50:38 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:38 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb83c3b-9cec-4959-8486-51fe6f1a348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d062f2c7-f16c-40e5-926f-f347de22ac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Volume volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 (c71c8ae2-e069-41d6-8d99-7e53e9c42583): created successfully Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d062f2c7-f16c-40e5-926f-f347de22ac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (c7ff5600-73b8-434d-beef-7df2ef045005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:50:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6e7f8f8c-e21d-4c47-ac14-93a78f32ac2b tempest-VolumesSnapshotTestJSON-407803813 None] Created volume successfully. Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Creating offline snapshot 1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 of volume c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2842af06-ce4e-4f3d-bb91-2f6bf0c916ca]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:39 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 Nov 05 17:50:39 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:39 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583" returned: 0 in 0.367s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:39 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 1G Nov 05 17:50:39 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:39 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 1G" returned: 0 in 0.444s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:39 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 Nov 05 17:50:39 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:40 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:40 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 is being set with open permissions: ugo+rw Nov 05 17:50:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:40 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 Nov 05 17:50:40 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:40 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:40 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.info Nov 05 17:50:40 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:40 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.info" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:40 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.info is being set with open permissions: ugo+rw Nov 05 17:50:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:40 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.info Nov 05 17:50:40 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:41 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.info" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-53a0a10a-b1ab-4511-b2dd-37108f88a31f tempest-VolumesSnapshotTestJSON-407803813 None] Create snapshot completed successfully Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (75e98b0f-2745-4e4f-85a3-baa5f7b4bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858b5da9-db63-44a6-b98a-2cc828c80b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858b5da9-db63-44a6-b98a-2cc828c80b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1769292768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0203edd-5330-4511-807d-01f619ce7bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:50:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:50:43Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6ebd9-2900-4e9e-9372-cd406f3d93a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6ebd9-2900-4e9e-9372-cd406f3d93a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b2fac4-4cf2-4f1b-8e17-575b55116741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b2fac4-4cf2-4f1b-8e17-575b55116741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a0203edd-5330-4511-807d-01f619ce7bbc', 'volume_name': 'volume-a0203edd-5330-4511-807d-01f619ce7bbc', 'volume_size': 2, 'snapshot_id': '1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86402f30-9861-4ff0-a915-a139b29f0823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86402f30-9861-4ff0-a915-a139b29f0823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9509f85-8a43-4edb-9c9f-de1fedce21f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Volume a0203edd-5330-4511-807d-01f619ce7bbc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a0203edd-5330-4511-807d-01f619ce7bbc', 'volume_size': 2, 'snapshot_id': '1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2'} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2-a0203edd-5330-4511-807d-01f619ce7bbc" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2-a0203edd-5330-4511-807d-01f619ce7bbc" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Creating volume a0203edd-5330-4511-807d-01f619ce7bbc from snapshot 1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-a0203edd-5330-4511-807d-01f619ce7bbc" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-a0203edd-5330-4511-807d-01f619ce7bbc" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] snapshot: 1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2, volume: a0203edd-5330-4511-807d-01f619ce7bbc, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34a84a-6133-4cc8-9160-d1ad946ead83]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:43 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 Nov 05 17:50:43 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:43 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab54bb-ae25-455d-8b54-6d5aedf92558]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:43 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 Nov 05 17:50:43 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:43 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:50:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:43 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc Nov 05 17:50:43 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Flow 'volume_create_manager' (6eb1825e-09c9-4374-8d45-dd0170e99ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def7981f-2ef1-495d-9f1a-a718854fc4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def7981f-2ef1-495d-9f1a-a718854fc4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1711678934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8350a2e5-fd3d-4d98-82ae-44daa67453a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0113336746dc41a0a6d7795c1089c732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1ac330b-5583-474b-8ad7-771bdaa14c4a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:50:44Z,use_quota=True,user_id='e4a50670509b405aa74d5805a92dd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a81cbe-f7d1-4051-812b-4369afe7d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a81cbe-f7d1-4051-812b-4369afe7d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3744d0d5-377f-4347-b51a-fddb075bba6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3744d0d5-377f-4347-b51a-fddb075bba6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8350a2e5-fd3d-4d98-82ae-44daa67453a4', 'volume_name': 'volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4', 'volume_size': 1, 'snapshot_id': 'a1ac330b-5583-474b-8ad7-771bdaa14c4a'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bb7294-24d8-4bd6-837f-e5e26815b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bb7294-24d8-4bd6-837f-e5e26815b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb02474-479f-4792-8b2f-833184bb5bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Volume 8350a2e5-fd3d-4d98-82ae-44daa67453a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4', 'volume_size': 1, 'snapshot_id': 'a1ac330b-5583-474b-8ad7-771bdaa14c4a'} Nov 05 17:50:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:50 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc" returned: 0 in 6.896s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:50:50 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Converted 1024.00 MB image at 148.47 MB/s Nov 05 17:50:50 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc is being set with open permissions: ugo+rw Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:50 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc Nov 05 17:50:50 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:50 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-a0203edd-5330-4511-807d-01f619ce7bbc" released by "_copy_volume_from_snapshot" :: held 8.000s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2-a0203edd-5330-4511-807d-01f619ce7bbc" released by "_create_volume_from_snapshot" :: held 8.080s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.095s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.246s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-quobyte-a1ac330b-5583-474b-8ad7-771bdaa14c4a-8350a2e5-fd3d-4d98-82ae-44daa67453a4" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-a1ac330b-5583-474b-8ad7-771bdaa14c4a-8350a2e5-fd3d-4d98-82ae-44daa67453a4" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Creating volume 8350a2e5-fd3d-4d98-82ae-44daa67453a4 from snapshot a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-quobyte-8350a2e5-fd3d-4d98-82ae-44daa67453a4" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9509f85-8a43-4edb-9c9f-de1fedce21f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0203edd-5330-4511-807d-01f619ce7bbc', 'volume_size': 2, 'snapshot_id': '1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106d7366-2291-4ecb-8bd0-5b47e377e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-8350a2e5-fd3d-4d98-82ae-44daa67453a4" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] snapshot: a1ac330b-5583-474b-8ad7-771bdaa14c4a, volume: 8350a2e5-fd3d-4d98-82ae-44daa67453a4, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:50:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Volume volume-a0203edd-5330-4511-807d-01f619ce7bbc (a0203edd-5330-4511-807d-01f619ce7bbc): created successfully Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106d7366-2291-4ecb-8bd0-5b47e377e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (75e98b0f-2745-4e4f-85a3-baa5f7b4bf16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-300b1e06-ade7-4921-a11c-43495a8bca00 tempest-VolumesSnapshotTestJSON-407803813 None] Created volume successfully. Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a098e75f-940a-4791-b894-d9898899afa7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:51 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a Nov 05 17:50:51 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:51 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e192488f-9478-4edb-9937-0afe71c1425a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-a0203edd-5330-4511-807d-01f619ce7bbc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-a0203edd-5330-4511-807d-01f619ce7bbc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:51 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f Nov 05 17:50:51 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-a0203edd-5330-4511-807d-01f619ce7bbc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-a0203edd-5330-4511-807d-01f619ce7bbc" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce23e3f-9a3f-49fe-a841-191afc332494]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:52 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc Nov 05 17:50:52 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:52 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f" returned: 0 in 0.506s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:52 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 Nov 05 17:50:52 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:52 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:52 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc Nov 05 17:50:52 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:52 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a0203edd-5330-4511-807d-01f619ce7bbc" returned: 0 in 0.327s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-a0203edd-5330-4511-807d-01f619ce7bbc" released by "delete_volume" :: held 0.883s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['953c2290-3e91-49d6-942b-d45ce391ce8f', 'fca3b898-c4f2-435f-a3a3-0a5829686a24', '39210b7c-cea3-43b1-b6a4-dbcb5b977cb8', '4085309d-ed7d-4632-ae65-e08cf87b07f1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:50:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:53 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:50:53 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-c71c8ae2-e069-41d6-8d99-7e53e9c42583" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-c71c8ae2-e069-41d6-8d99-7e53e9c42583" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Deleting offline snapshot 1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 of volume c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] snapshot_file for this snap is: volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b91c59-1a4a-4d29-9895-95988fc8b289]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.537s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:50:53 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Deleted volume successfully. Nov 05 17:50:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bdc217f-50d4-46c2-bfdd-d6168c9990b1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-a0203edd-5330-4511-807d-01f619ce7bbc-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:53 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 Nov 05 17:50:53 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:54 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" returned: 0 in 1.055s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:50:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb9e3c3-3bf5-4894-b141-ba54d05e5429]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:54 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 Nov 05 17:50:54 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:55 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583" returned: 0 in 1.232s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:55 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 Nov 05 17:50:55 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:56 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" returned: 0 in 1.037s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:57 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2 Nov 05 17:50:57 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:50:57 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 05 17:50:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583.1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" returned: 0 in 0.484s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:50:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2" released by "_delete_snapshot" :: held 4.136s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-c71c8ae2-e069-41d6-8d99-7e53e9c42583" released by "delete_snapshot" :: held 4.186s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:57 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['f3f44181-4b01-48d2-8d17-b9d3b1a57793', '7ce36798-5d51-4ec0-8ea6-9a770b8d9035', 'a89385ef-576f-4b6c-9962-642c310cf61a', 'd895b09b-6f6b-4d96-9fdc-57888a0a99b4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:50:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Delete snapshot completed successfully. Nov 05 17:50:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4547ddbe-8d06-470c-9fa3-afa7fc9242f9 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-1cd5c19d-0d6b-41c4-b0ee-17172c9f96f2-delete_snapshot" released by "delete_snapshot" :: held 4.554s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:50:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-c71c8ae2-e069-41d6-8d99-7e53e9c42583-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-c71c8ae2-e069-41d6-8d99-7e53e9c42583-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-c71c8ae2-e069-41d6-8d99-7e53e9c42583" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:50:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-c71c8ae2-e069-41d6-8d99-7e53e9c42583" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:50:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c3768-a6d7-4c93-96f2-0444a4a19ec3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:50:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:50:59 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 Nov 05 17:50:59 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:00 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583" returned: 0 in 1.119s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:00 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583 Nov 05 17:51:00 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:01 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c71c8ae2-e069-41d6-8d99-7e53e9c42583" returned: 0 in 0.888s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-c71c8ae2-e069-41d6-8d99-7e53e9c42583" released by "delete_volume" :: held 2.260s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['0cdd5417-a52a-4bbc-b2a7-987673f413a0', '68070a04-f3fc-4943-a024-dbdd8e636c13', 'cf7d2d2f-7c22-4b96-8bed-6729ac665e5a', '5cb998a9-2931-4230-8d1b-450672500e56'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:01 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:01 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:02 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4" returned: 0 in 10.253s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f, size 1024.00 MB, duration 10.25 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:51:02 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Converted 1024.00 MB image at 99.86 MB/s Nov 05 17:51:02 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 is being set with open permissions: ugo+rw Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:02 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 Nov 05 17:51:02 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:02 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.682s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Deleted volume successfully. Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84f51a24-b34b-482b-9e53-7b26a6232c13 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-c71c8ae2-e069-41d6-8d99-7e53e9c42583-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:02 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-8350a2e5-fd3d-4d98-82ae-44daa67453a4" released by "_copy_volume_from_snapshot" :: held 11.729s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-a1ac330b-5583-474b-8ad7-771bdaa14c4a-8350a2e5-fd3d-4d98-82ae-44daa67453a4" released by "_create_volume_from_snapshot" :: held 11.836s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.872s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb02474-479f-4792-8b2f-833184bb5bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4', 'volume_size': 1, 'snapshot_id': 'a1ac330b-5583-474b-8ad7-771bdaa14c4a'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6763b954-0a57-4a84-99cc-a6eee64f950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Volume volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 (8350a2e5-fd3d-4d98-82ae-44daa67453a4): created successfully Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6763b954-0a57-4a84-99cc-a6eee64f950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Flow 'volume_create_manager' (6eb1825e-09c9-4374-8d45-dd0170e99ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-afc36064-1877-4dac-bc77-ce18f6be3927 tempest-TestStampPattern-913414584 None] Created volume successfully. Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (83dd79e3-b5e2-4b45-b08e-1a0662c40683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda94e4b-56dd-4e41-ba17-424c3b335535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda94e4b-56dd-4e41-ba17-424c3b335535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1186917362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0730b030-68f8-490c-9538-9a647a02a9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:03Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f32bffe-31f9-412b-8e6d-84cd718c631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f32bffe-31f9-412b-8e6d-84cd718c631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d675736-d1c2-4a26-9d05-e96f065cb007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d675736-d1c2-4a26-9d05-e96f065cb007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0730b030-68f8-490c-9538-9a647a02a9b3', 'volume_name': 'volume-0730b030-68f8-490c-9538-9a647a02a9b3', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50516634-e8c4-49c8-b525-e4545f02a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50516634-e8c4-49c8-b525-e4545f02a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee991f8-ee9e-41bc-a408-75e870eece6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Volume 0730b030-68f8-490c-9538-9a647a02a9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0730b030-68f8-490c-9538-9a647a02a9b3', 'volume_size': 1} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1186917362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0730b030-68f8-490c-9538-9a647a02a9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:03Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Creating volume 0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:51:03 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:03 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 1073741824 Nov 05 17:51:03 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:03 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 1073741824" returned: 0 in 0.512s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:04 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 Nov 05 17:51:04 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:04 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee991f8-ee9e-41bc-a408-75e870eece6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0730b030-68f8-490c-9538-9a647a02a9b3', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d35bb0-5c51-41d3-b4ff-693b5c96404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Volume volume-0730b030-68f8-490c-9538-9a647a02a9b3 (0730b030-68f8-490c-9538-9a647a02a9b3): created successfully Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d35bb0-5c51-41d3-b4ff-693b5c96404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (83dd79e3-b5e2-4b45-b08e-1a0662c40683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0cf46bf3-e4a9-4f68-b9b7-7092f8323bf7 tempest-VolumesSnapshotTestJSON-407803813 None] Created volume successfully. Nov 05 17:51:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Creating offline snapshot effd5c04-c60a-48d1-b086-df829a943f70 of volume 0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:51:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88980bc-05ac-46c2-9f8f-34da0ebc192c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:05 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 Nov 05 17:51:05 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:05 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:05 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 1G Nov 05 17:51:05 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:06 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 1G" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0730b030-68f8-490c-9538-9a647a02a9b3 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:06 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0730b030-68f8-490c-9538-9a647a02a9b3 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 Nov 05 17:51:06 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:06 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0730b030-68f8-490c-9538-9a647a02a9b3 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:06 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 is being set with open permissions: ugo+rw Nov 05 17:51:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:06 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 Nov 05 17:51:06 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:06 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70" returned: 0 in 0.226s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:06 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.info Nov 05 17:51:06 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:07 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.info" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:07 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.info is being set with open permissions: ugo+rw Nov 05 17:51:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:07 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.info Nov 05 17:51:07 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:07 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.info" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-744264f0-9383-4e38-a868-412d2424b56e tempest-VolumesSnapshotTestJSON-407803813 None] Create snapshot completed successfully Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (0e69a9b0-5162-403f-82ef-741df7dbcc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec0165e-209a-4805-a345-62494c236437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec0165e-209a-4805-a345-62494c236437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1296838599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89aed40c-0784-4a0a-a15a-8908c4148b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f263af38374a4a4589adb29cfd190bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=effd5c04-c60a-48d1-b086-df829a943f70,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:08Z,use_quota=True,user_id='09083e28c7894e3a8ef4eb3367bd1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f6dc38-d386-43ff-b9ab-452d1dcedd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f6dc38-d386-43ff-b9ab-452d1dcedd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dbdc54-2662-4111-9286-f470226bc975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dbdc54-2662-4111-9286-f470226bc975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89aed40c-0784-4a0a-a15a-8908c4148b23', 'volume_name': 'volume-89aed40c-0784-4a0a-a15a-8908c4148b23', 'volume_size': 1, 'snapshot_id': 'effd5c04-c60a-48d1-b086-df829a943f70'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb48e5c-9f08-488f-8182-8fe11e26ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb48e5c-9f08-488f-8182-8fe11e26ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b9dba7-f496-47a5-825b-4c38ffd1fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Volume 89aed40c-0784-4a0a-a15a-8908c4148b23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89aed40c-0784-4a0a-a15a-8908c4148b23', 'volume_size': 1, 'snapshot_id': 'effd5c04-c60a-48d1-b086-df829a943f70'} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-effd5c04-c60a-48d1-b086-df829a943f70-89aed40c-0784-4a0a-a15a-8908c4148b23" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-effd5c04-c60a-48d1-b086-df829a943f70-89aed40c-0784-4a0a-a15a-8908c4148b23" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Creating volume 89aed40c-0784-4a0a-a15a-8908c4148b23 from snapshot effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-89aed40c-0784-4a0a-a15a-8908c4148b23" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-89aed40c-0784-4a0a-a15a-8908c4148b23" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] snapshot: effd5c04-c60a-48d1-b086-df829a943f70, volume: 89aed40c-0784-4a0a-a15a-8908c4148b23, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c181030c-5387-410a-a1b2-091d305ca919]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:08 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 Nov 05 17:51:08 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:08 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0730b030-68f8-490c-9538-9a647a02a9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10ba81-5289-401b-a424-b5336ece0881]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:08 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 Nov 05 17:51:08 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:09 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:51:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:51:09 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:51:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:09 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 Nov 05 17:51:09 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:51:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:13 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:13 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:14 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.281s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:51:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:51:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:51:15 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23" returned: 0 in 5.918s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:51:15 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Converted 1024.00 MB image at 173.00 MB/s Nov 05 17:51:15 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 is being set with open permissions: ugo+rw Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:15 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 Nov 05 17:51:15 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:15 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23" returned: 0 in 0.230s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-89aed40c-0784-4a0a-a15a-8908c4148b23" released by "_copy_volume_from_snapshot" :: held 6.967s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=69,cinder:SELECT=63,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-effd5c04-c60a-48d1-b086-df829a943f70-89aed40c-0784-4a0a-a15a-8908c4148b23" released by "_create_volume_from_snapshot" :: held 7.042s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.063s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b9dba7-f496-47a5-825b-4c38ffd1fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89aed40c-0784-4a0a-a15a-8908c4148b23', 'volume_size': 1, 'snapshot_id': 'effd5c04-c60a-48d1-b086-df829a943f70'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe720ff4-1400-4ef0-8c20-af0fe4040d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Volume volume-89aed40c-0784-4a0a-a15a-8908c4148b23 (89aed40c-0784-4a0a-a15a-8908c4148b23): created successfully Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe720ff4-1400-4ef0-8c20-af0fe4040d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Flow 'volume_create_manager' (0e69a9b0-5162-403f-82ef-741df7dbcc71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-87dc355a-746d-4eb1-a1f1-b6081dccc1e6 tempest-VolumesSnapshotTestJSON-407803813 None] Created volume successfully. Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-89aed40c-0784-4a0a-a15a-8908c4148b23-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-89aed40c-0784-4a0a-a15a-8908c4148b23-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-89aed40c-0784-4a0a-a15a-8908c4148b23" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-89aed40c-0784-4a0a-a15a-8908c4148b23" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2bb31a-2da2-4680-8c08-21236db43685]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:15 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 Nov 05 17:51:15 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:16 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:16 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23 Nov 05 17:51:16 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:16 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-89aed40c-0784-4a0a-a15a-8908c4148b23" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-89aed40c-0784-4a0a-a15a-8908c4148b23" released by "delete_volume" :: held 0.653s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['b3f3d3d0-b327-4e2c-ad1e-85b1a3ef87e6', 'f0e09665-b116-48ad-83d6-3f9cd170a6e7', 'e8e13c9c-d93c-41b4-b831-72884f58383b', 'c290fe26-eea3-4819-b988-dea1cc1a489c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:16 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:16 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:16 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Deleted volume successfully. Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f368153-180f-4b08-a1fa-86de31eb9bd1 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-89aed40c-0784-4a0a-a15a-8908c4148b23-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-effd5c04-c60a-48d1-b086-df829a943f70-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-effd5c04-c60a-48d1-b086-df829a943f70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-0730b030-68f8-490c-9538-9a647a02a9b3" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-0730b030-68f8-490c-9538-9a647a02a9b3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-effd5c04-c60a-48d1-b086-df829a943f70" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-effd5c04-c60a-48d1-b086-df829a943f70" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Deleting offline snapshot effd5c04-c60a-48d1-b086-df829a943f70 of volume 0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] snapshot_file for this snap is: volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bca1a7-4225-42d4-ad79-f23c008615d2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:17 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 Nov 05 17:51:17 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:17 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0730b030-68f8-490c-9538-9a647a02a9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b476f137-8cb4-4bfd-ac05-d0b95e33f562]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:17 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 Nov 05 17:51:17 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:17 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3" returned: 0 in 0.477s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:17 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 Nov 05 17:51:17 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:18 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:18 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70 Nov 05 17:51:18 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:18 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3.effd5c04-c60a-48d1-b086-df829a943f70" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-effd5c04-c60a-48d1-b086-df829a943f70" released by "_delete_snapshot" :: held 1.517s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-0730b030-68f8-490c-9538-9a647a02a9b3" released by "delete_snapshot" :: held 1.542s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:18 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['2e636c58-bbc0-4fc6-912b-d98c2ac257ee', 'c15cad78-b4a3-4929-a9ec-034ab40a8b3c', '65af2617-0942-450d-913b-05648032d3d6', 'bfc5ee6a-2724-4254-a787-52b0eb0b8c42'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Delete snapshot completed successfully. Nov 05 17:51:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e82974-2f81-43f1-8a07-0fceedc6917d tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-effd5c04-c60a-48d1-b086-df829a943f70-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-0730b030-68f8-490c-9538-9a647a02a9b3-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-0730b030-68f8-490c-9538-9a647a02a9b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-0730b030-68f8-490c-9538-9a647a02a9b3" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-0730b030-68f8-490c-9538-9a647a02a9b3" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4fcb7-fcb1-42a8-83d2-ba8c682929f5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:19 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 Nov 05 17:51:19 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:19 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3" returned: 0 in 0.398s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:19 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3 Nov 05 17:51:19 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:19 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0730b030-68f8-490c-9538-9a647a02a9b3" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-0730b030-68f8-490c-9538-9a647a02a9b3" released by "delete_volume" :: held 0.712s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:19 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['6061a7e2-6f85-45eb-be13-0d276709db24', '820e6a8e-36bb-4e43-9999-c04d08e9b796', '7913d123-68be-4209-8cbc-95e8444a8a47', 'b7c6186a-b078-4a20-97d3-2412b9951706'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:20 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:20 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:20 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.293s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Deleted volume successfully. Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-1e8dad5f-e8f6-443c-922e-f7f75409741e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-1e8dad5f-e8f6-443c-922e-f7f75409741e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8a5a8a1e-9f9a-424a-a6ad-3b79ac38f36f tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-0730b030-68f8-490c-9538-9a647a02a9b3-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "cinder-quobyte-1e8dad5f-e8f6-443c-922e-f7f75409741e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1e8dad5f-e8f6-443c-922e-f7f75409741e" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d25e2-c806-435a-aa3d-80543bab4fd4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:20 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e Nov 05 17:51:20 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:20 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:20 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e Nov 05 17:51:20 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:21 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1e8dad5f-e8f6-443c-922e-f7f75409741e" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-quobyte-1e8dad5f-e8f6-443c-922e-f7f75409741e" released by "delete_volume" :: held 0.667s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Created reservations ['3e0c7089-b5a2-488d-8956-112f95bdd8cb', '972dda1c-519d-4547-ab9f-21248cc55391', 'be3ff28c-4686-4411-93db-b3379a9b3af1', 'b4115bfe-dafa-43d5-8b3c-798c04fcbff8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:21 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:21 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:21 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Deleted volume successfully. Nov 05 17:51:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6030d6b-e745-4e7d-8651-2280a0913423 tempest-VolumesSnapshotTestJSON-407803813 None] Lock "cinder-1e8dad5f-e8f6-443c-922e-f7f75409741e-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f9d3f2f2-dcf9-410d-82c8-83297e138e38 req-c423299f-0c09-4650-8594-da719e13c24f tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f9d3f2f2-dcf9-410d-82c8-83297e138e38 req-c423299f-0c09-4650-8594-da719e13c24f tempest-TestStampPattern-913414584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-f9d3f2f2-dcf9-410d-82c8-83297e138e38 req-c423299f-0c09-4650-8594-da719e13c24f tempest-TestStampPattern-913414584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-f9d3f2f2-dcf9-410d-82c8-83297e138e38 req-c423299f-0c09-4650-8594-da719e13c24f tempest-TestStampPattern-913414584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8', 'name': 'volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64cf971f-71c9-41c3-8308-dfb618cf9e9f', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 17:51:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-f9d3f2f2-dcf9-410d-82c8-83297e138e38 req-c423299f-0c09-4650-8594-da719e13c24f tempest-TestStampPattern-913414584 None] attachment_update completed successfully. Nov 05 17:51:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-2d84e382-9cc4-45cf-a900-a2123f4b9eb9 req-4fed687f-7777-402f-9de1-68754d0eae41 tempest-TestStampPattern-913414584 None] Terminate volume connection completed successfully. Nov 05 17:51:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-2d84e382-9cc4-45cf-a900-a2123f4b9eb9 req-4fed687f-7777-402f-9de1-68754d0eae41 tempest-TestStampPattern-913414584 None] Deleting attachment 64cf971f-71c9-41c3-8308-dfb618cf9e9f. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=96,cinder:INSERT=25,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Flow 'volume_create_manager' (25e70e17-eda7-48c9-873d-319e872d308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e391f02-b871-4aa3-94fa-ea78ed93ce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e391f02-b871-4aa3-94fa-ea78ed93ce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-39001607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0abda9d29c4251b7de48630020a616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:29Z,use_quota=True,user_id='c46f3610b67b40e7813ad87aa79b2ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba595d0f-92b9-435a-8c0f-c41ce9aaa8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba595d0f-92b9-435a-8c0f-c41ce9aaa8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddf42e9-dbb8-4e07-b79c-f2f132a99b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddf42e9-dbb8-4e07-b79c-f2f132a99b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f', 'volume_name': 'volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2285230-2b35-49f5-86fe-4dcc33050bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2285230-2b35-49f5-86fe-4dcc33050bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a9026-8f09-47c0-abbc-a4ee6b2f923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f', 'volume_size': 1} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-39001607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0abda9d29c4251b7de48630020a616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:29Z,use_quota=True,user_id='c46f3610b67b40e7813ad87aa79b2ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Creating volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:51:29 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:51:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:29 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f 1073741824 Nov 05 17:51:29 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:30 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f 1073741824" returned: 0 in 0.503s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:30 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f Nov 05 17:51:30 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:30 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a9026-8f09-47c0-abbc-a4ee6b2f923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e61ed9-08ce-4736-963c-27b7e4807785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Volume volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f (1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f): created successfully Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e61ed9-08ce-4736-963c-27b7e4807785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Flow 'volume_create_manager' (25e70e17-eda7-48c9-873d-319e872d308d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d9cd5661-ce79-4934-843e-3cb36bd554d5 tempest-VolumesSnapshotListTestJSON-1553743560 None] Created volume successfully. Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-8350a2e5-fd3d-4d98-82ae-44daa67453a4-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Lock "cinder-8350a2e5-fd3d-4d98-82ae-44daa67453a4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-quobyte-8350a2e5-fd3d-4d98-82ae-44daa67453a4" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-8350a2e5-fd3d-4d98-82ae-44daa67453a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f337c7f-4281-433b-8d9e-f944c61aaf68]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:30 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 Nov 05 17:51:30 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:31 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:31 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4 Nov 05 17:51:31 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:31 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8350a2e5-fd3d-4d98-82ae-44daa67453a4" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-8350a2e5-fd3d-4d98-82ae-44daa67453a4" released by "delete_volume" :: held 0.622s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Created reservations ['216a8835-3a10-42df-bdfc-4fd4e47cb0d9', '062bf741-a7ec-41e6-a1e9-453e9decfc7f', '36c75f19-36f6-467a-939a-3570b086e2ba', 'a9eb4cd1-cd83-44b3-9811-1df93f7e398a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:31 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:31 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Creating offline snapshot a4e3d291-eb15-4741-a7b9-b4ada4897d65 of volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2237da4-63f1-452b-b184-5a5c2ea419d0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:31 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f Nov 05 17:51:31 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:31 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Deleted volume successfully. Nov 05 17:51:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-622ca7ff-bbdd-4288-a6bf-895dbc896e76 tempest-TestStampPattern-913414584 None] Lock "cinder-8350a2e5-fd3d-4d98-82ae-44daa67453a4-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:32 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:32 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 1G Nov 05 17:51:32 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-a1ac330b-5583-474b-8ad7-771bdaa14c4a-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Lock "cinder-a1ac330b-5583-474b-8ad7-771bdaa14c4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-quobyte-7fba8ad7-5fa4-4502-aeea-2654f870f56f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-7fba8ad7-5fa4-4502-aeea-2654f870f56f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-quobyte-a1ac330b-5583-474b-8ad7-771bdaa14c4a" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-a1ac330b-5583-474b-8ad7-771bdaa14c4a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Deleting offline snapshot a1ac330b-5583-474b-8ad7-771bdaa14c4a of volume 7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] snapshot_file for this snap is: volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf5b5f-ab37-43d5-ac2b-394c873e5126]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:32 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a Nov 05 17:51:32 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:32 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 1G" returned: 0 in 0.400s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:32 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 Nov 05 17:51:32 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:32 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d86b0ac-fdc2-46fc-a32f-8d8ecc9a1e6b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:32 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f Nov 05 17:51:32 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:32 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:32 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 is being set with open permissions: ugo+rw Nov 05 17:51:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:32 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 Nov 05 17:51:32 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:33 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:33 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.info Nov 05 17:51:33 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:33 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f" returned: 0 in 0.543s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:33 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a Nov 05 17:51:33 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:33 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.info" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:33 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.info is being set with open permissions: ugo+rw Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:33 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.info Nov 05 17:51:33 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:33 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:33 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a Nov 05 17:51:33 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:33 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.info" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7f6eaed1-8547-43fa-84c3-a8b4dad819a8 tempest-VolumesSnapshotListTestJSON-1553743560 None] Create snapshot completed successfully Nov 05 17:51:33 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f.a1ac330b-5583-474b-8ad7-771bdaa14c4a" returned: 0 in 0.253s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-a1ac330b-5583-474b-8ad7-771bdaa14c4a" released by "_delete_snapshot" :: held 1.607s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-7fba8ad7-5fa4-4502-aeea-2654f870f56f" released by "delete_snapshot" :: held 1.632s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Created reservations ['b72b47c2-5330-425b-9d20-4e9ead027a10', 'aa0858ca-499a-4bfa-8699-e4f14e1fcc37', '54b6a103-7233-47a0-9ad8-bceaddb91b17', 'd078cbab-f755-47e6-9a39-1fad048eb0c4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Creating offline snapshot dcca9c3c-a9f2-428c-90d3-70873fe74830 of volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca18b6-8ff2-41f9-93a7-00124de1d5d5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Delete snapshot completed successfully. Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-db78f6de-da63-44cd-8910-5a074dc55fd7 tempest-TestStampPattern-913414584 None] Lock "cinder-a1ac330b-5583-474b-8ad7-771bdaa14c4a-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:34 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 Nov 05 17:51:34 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:34 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:34 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 1G Nov 05 17:51:34 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:34 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 1G" returned: 0 in 0.461s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:34 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 Nov 05 17:51:34 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:35 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:35 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 is being set with open permissions: ugo+rw Nov 05 17:51:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:35 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 Nov 05 17:51:35 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:35 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.605s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-56d2129b-a3a0-4dd1-b21e-315527a6cf92 tempest-VolumesSnapshotListTestJSON-1553743560 None] Create snapshot completed successfully Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Creating offline snapshot cdd30674-d8d0-41ae-a21e-5cd783eb854f of volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f6aa3-a488-4658-8de3-1af925bed342]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:36 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 Nov 05 17:51:36 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:36 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:36 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f 1G Nov 05 17:51:36 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:37 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f 1G" returned: 0 in 0.468s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:37 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f Nov 05 17:51:37 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:37 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:37 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f is being set with open permissions: ugo+rw Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:37 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f Nov 05 17:51:37 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:37 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f" returned: 0 in 0.228s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.520s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0637c2a0-36b8-4474-a955-40dbb3be297e tempest-VolumesSnapshotListTestJSON-1553743560 None] Create snapshot completed successfully Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-7fba8ad7-5fa4-4502-aeea-2654f870f56f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Lock "cinder-7fba8ad7-5fa4-4502-aeea-2654f870f56f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Acquiring lock "cinder-quobyte-7fba8ad7-5fa4-4502-aeea-2654f870f56f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-7fba8ad7-5fa4-4502-aeea-2654f870f56f" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8c5fa7-51d0-4982-ac91-d8053ec64660]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:38 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f Nov 05 17:51:38 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:38 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:38 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f Nov 05 17:51:38 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:38 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7fba8ad7-5fa4-4502-aeea-2654f870f56f" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Lock "cinder-quobyte-7fba8ad7-5fa4-4502-aeea-2654f870f56f" released by "delete_volume" :: held 0.656s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Created reservations ['dbaa5fb2-5780-4e1e-89bd-3e7ea83a5d8f', '9088aeb6-c7c5-4324-a069-4a7f1db1e3c3', '1ab4e04b-cf8a-4e83-8944-672f09fe2da0', 'fe6aca73-1ca2-497a-93f9-555ae3bd5337'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:38 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:38 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:39 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Deleted volume successfully. Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541ffc25-db99-4b07-89a8-0964e25cb498 tempest-TestStampPattern-913414584 None] Lock "cinder-7fba8ad7-5fa4-4502-aeea-2654f870f56f-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-cdd30674-d8d0-41ae-a21e-5cd783eb854f-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-cdd30674-d8d0-41ae-a21e-5cd783eb854f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-quobyte-cdd30674-d8d0-41ae-a21e-5cd783eb854f" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-cdd30674-d8d0-41ae-a21e-5cd783eb854f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Deleting offline snapshot cdd30674-d8d0-41ae-a21e-5cd783eb854f of volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] snapshot_file for this snap is: volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa7a3c3-418c-4086-aae9-cf8c1d8c82b7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:39 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f Nov 05 17:51:39 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:39 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d8ef50-9ecf-4ff7-b55f-d4f5b0ab1b68]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:39 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 Nov 05 17:51:39 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:40 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:40 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f Nov 05 17:51:40 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:40 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f" returned: 0 in 0.464s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:40 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f Nov 05 17:51:40 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:40 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.cdd30674-d8d0-41ae-a21e-5cd783eb854f" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-cdd30674-d8d0-41ae-a21e-5cd783eb854f" released by "_delete_snapshot" :: held 1.580s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" released by "delete_snapshot" :: held 1.610s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:40 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Created reservations ['40ed4025-6f6f-4aab-8aed-323041ee994f', '6788e4f0-f5b8-4216-bc8f-1772fa8c887d', '518705b0-b3d2-4f5c-a9d3-4e14710e1089', '4f8946d4-3726-4d6b-9a79-4d21701168a3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Delete snapshot completed successfully. Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-980ad844-38d1-4518-832d-7ae5667cb123 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-cdd30674-d8d0-41ae-a21e-5cd783eb854f-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-dcca9c3c-a9f2-428c-90d3-70873fe74830-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-dcca9c3c-a9f2-428c-90d3-70873fe74830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-quobyte-dcca9c3c-a9f2-428c-90d3-70873fe74830" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-dcca9c3c-a9f2-428c-90d3-70873fe74830" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Deleting offline snapshot dcca9c3c-a9f2-428c-90d3-70873fe74830 of volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] snapshot_file for this snap is: volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[145028d5-e4b1-409e-89f3-b87f2f943379]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:41 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 Nov 05 17:51:41 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:41 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a08b68d-2a71-4164-b78d-65ecd0a5dce4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:42 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 Nov 05 17:51:42 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:42 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:42 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 Nov 05 17:51:42 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:42 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:42 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830 Nov 05 17:51:42 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:42 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.dcca9c3c-a9f2-428c-90d3-70873fe74830" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-dcca9c3c-a9f2-428c-90d3-70873fe74830" released by "_delete_snapshot" :: held 1.534s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" released by "delete_snapshot" :: held 1.556s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Created reservations ['3cb5b5f5-3dd3-4b5b-83b8-0fb49930c02d', '77dc4d4e-746f-428d-9da1-efc5420aa426', '1687c488-f7e1-4c4b-8f78-f7222eaf7416', 'bbe8e605-dc6c-4322-abb7-398962ff74fc'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Delete snapshot completed successfully. Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6f1adee3-be5c-4751-af44-f7023fe16a6e tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-dcca9c3c-a9f2-428c-90d3-70873fe74830-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-a4e3d291-eb15-4741-a7b9-b4ada4897d65-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-a4e3d291-eb15-4741-a7b9-b4ada4897d65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-quobyte-a4e3d291-eb15-4741-a7b9-b4ada4897d65" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-a4e3d291-eb15-4741-a7b9-b4ada4897d65" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Deleting offline snapshot a4e3d291-eb15-4741-a7b9-b4ada4897d65 of volume 1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] snapshot_file for this snap is: volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4de1d3a-e83d-4512-8585-c53da2feda6b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:43 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 Nov 05 17:51:43 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:44 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a97df90-41d1-421e-a863-e1f5d19cee7f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:44 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f Nov 05 17:51:44 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:44 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:44 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 Nov 05 17:51:44 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:44 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:44 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65 Nov 05 17:51:44 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:45 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f.a4e3d291-eb15-4741-a7b9-b4ada4897d65" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-a4e3d291-eb15-4741-a7b9-b4ada4897d65" released by "_delete_snapshot" :: held 1.474s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" released by "delete_snapshot" :: held 1.500s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Created reservations ['c7871914-0dba-426a-9803-e1be7396c487', 'f3580fed-cdaf-4fc0-aae8-d181441246b8', '86f0842b-8690-4bec-925b-124254e94594', 'f2b90aaa-64a8-466b-81da-5cccd1df0392'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Delete snapshot completed successfully. Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f1ee1198-4884-482c-aa11-9b41c5308043 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-a4e3d291-eb15-4741-a7b9-b4ada4897d65-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c5728-062f-4f13-99f1-aee1cf2f825a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:45 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f Nov 05 17:51:45 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:46 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:46 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f Nov 05 17:51:46 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:46 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-quobyte-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f" released by "delete_volume" :: held 0.696s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Created reservations ['fe48d724-aebf-4efe-803b-6d30759f87f6', '49c6d786-29c2-4eb9-baa4-b4c0d3cc1c74', '85566049-4fce-4ece-b7d4-3c14ea6706da', 'e38c1977-f204-40fb-be0a-d22131b25b41'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:46 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:51:46 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:46 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:51:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Deleted volume successfully. Nov 05 17:51:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f5ef3032-6bd3-44d4-9448-206e3479d6c2 tempest-VolumesSnapshotListTestJSON-1553743560 None] Lock "cinder-1ea03a5e-c6df-4ce7-ba2d-8c5e4ee92f5f-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Flow 'volume_create_manager' (4d0a8723-3720-4ae4-98b4-32863b78f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4466c6-e811-45f6-8ee5-517e4837c7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4466c6-e811-45f6-8ee5-517e4837c7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1279501394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4951c2e5-0295-4124-9a60-c0a18a27858a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e12485086a747fd8144b1bf48c7dcb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:51Z,use_quota=True,user_id='d8a0b108721f43edbc2657c3abdd4798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2044ea6-cf1b-443c-95a2-9fdecc233c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2044ea6-cf1b-443c-95a2-9fdecc233c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1f087f-e4d4-48c3-a3fe-0a3da46ee57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1f087f-e4d4-48c3-a3fe-0a3da46ee57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4951c2e5-0295-4124-9a60-c0a18a27858a', 'volume_name': 'volume-4951c2e5-0295-4124-9a60-c0a18a27858a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e657f70e-e6fe-4962-85ca-45ac2e86c3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e657f70e-e6fe-4962-85ca-45ac2e86c3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22418d49-de3d-4351-a9ab-2688f6fffe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Volume 4951c2e5-0295-4124-9a60-c0a18a27858a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4951c2e5-0295-4124-9a60-c0a18a27858a', 'volume_size': 1} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1279501394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4951c2e5-0295-4124-9a60-c0a18a27858a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e12485086a747fd8144b1bf48c7dcb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:51Z,use_quota=True,user_id='d8a0b108721f43edbc2657c3abdd4798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Creating volume 4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:51:51 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:51 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a 1073741824 Nov 05 17:51:51 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:51 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a 1073741824" returned: 0 in 0.457s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:51 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a Nov 05 17:51:51 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:51 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22418d49-de3d-4351-a9ab-2688f6fffe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4951c2e5-0295-4124-9a60-c0a18a27858a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e852ff-da31-4344-a14a-83347f988eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Volume volume-4951c2e5-0295-4124-9a60-c0a18a27858a (4951c2e5-0295-4124-9a60-c0a18a27858a): created successfully Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e852ff-da31-4344-a14a-83347f988eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Flow 'volume_create_manager' (4d0a8723-3720-4ae4-98b4-32863b78f461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-98307f96-1d68-4972-9817-0a8132a42bc1 tempest-VolumeDependencyTests-1707397108 None] Created volume successfully. Nov 05 17:51:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Creating offline snapshot 05725813-27b5-4e89-b3e8-5a4e8815a321 of volume 4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:51:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e281f754-8eff-411c-b979-5ed304c299f1]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:52 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a Nov 05 17:51:52 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:52 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:52 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 1G Nov 05 17:51:52 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:53 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 1G" returned: 0 in 0.439s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4951c2e5-0295-4124-9a60-c0a18a27858a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:53 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4951c2e5-0295-4124-9a60-c0a18a27858a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 Nov 05 17:51:53 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:53 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4951c2e5-0295-4124-9a60-c0a18a27858a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:53 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 is being set with open permissions: ugo+rw Nov 05 17:51:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:53 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 Nov 05 17:51:53 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:53 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:53 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.info Nov 05 17:51:53 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:54 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.info" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:54 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.info is being set with open permissions: ugo+rw Nov 05 17:51:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:54 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.info Nov 05 17:51:54 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:54 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.info" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e5751de9-3fcf-454e-92e1-3a35ad5b8b11 tempest-VolumeDependencyTests-1707397108 None] Create snapshot completed successfully Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Flow 'volume_create_manager' (93f52a26-e58a-45b2-ad89-d3b4f4ce1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3dae26-c001-4d79-ae9b-72fbe1db5a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3dae26-c001-4d79-ae9b-72fbe1db5a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-582591330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7976ce-cc13-472e-bac5-dc01dbc55f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e12485086a747fd8144b1bf48c7dcb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05725813-27b5-4e89-b3e8-5a4e8815a321,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:51:56Z,use_quota=True,user_id='d8a0b108721f43edbc2657c3abdd4798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5c2417-afa3-4e87-923a-f47e5e540ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5c2417-afa3-4e87-923a-f47e5e540ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4fab6b-60a5-4e2d-b945-4a2fb5fefe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4fab6b-60a5-4e2d-b945-4a2fb5fefe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a7976ce-cc13-472e-bac5-dc01dbc55f00', 'volume_name': 'volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00', 'volume_size': 1, 'snapshot_id': '05725813-27b5-4e89-b3e8-5a4e8815a321'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ddc14d-e71e-49d8-a637-b5a797300aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ddc14d-e71e-49d8-a637-b5a797300aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5590285-bf89-4ceb-aa1c-a36022fa3772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:51:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Volume 0a7976ce-cc13-472e-bac5-dc01dbc55f00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00', 'volume_size': 1, 'snapshot_id': '05725813-27b5-4e89-b3e8-5a4e8815a321'} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-quobyte-05725813-27b5-4e89-b3e8-5a4e8815a321-0a7976ce-cc13-472e-bac5-dc01dbc55f00" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-05725813-27b5-4e89-b3e8-5a4e8815a321-0a7976ce-cc13-472e-bac5-dc01dbc55f00" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Creating volume 0a7976ce-cc13-472e-bac5-dc01dbc55f00 from snapshot 05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-quobyte-0a7976ce-cc13-472e-bac5-dc01dbc55f00" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-0a7976ce-cc13-472e-bac5-dc01dbc55f00" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] snapshot: 05725813-27b5-4e89-b3e8-5a4e8815a321, volume: 0a7976ce-cc13-472e-bac5-dc01dbc55f00, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf1cc06-a66d-4e57-b1b0-b576c7e40e67]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:56 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 Nov 05 17:51:56 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:56 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4951c2e5-0295-4124-9a60-c0a18a27858a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcb4719-ac03-407e-a08e-6479b511abc8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:51:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:56 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a Nov 05 17:51:56 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:51:57 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Nov 05 17:51:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:51:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:51:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:51:57 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:51:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:51:57 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 Nov 05 17:51:57 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:04 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00" returned: 0 in 6.970s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:52:04 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Converted 1024.00 MB image at 146.89 MB/s Nov 05 17:52:04 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 is being set with open permissions: ugo+rw Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:04 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 Nov 05 17:52:04 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:04 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-0a7976ce-cc13-472e-bac5-dc01dbc55f00" released by "_copy_volume_from_snapshot" :: held 8.119s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-05725813-27b5-4e89-b3e8-5a4e8815a321-0a7976ce-cc13-472e-bac5-dc01dbc55f00" released by "_create_volume_from_snapshot" :: held 8.189s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.221s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5590285-bf89-4ceb-aa1c-a36022fa3772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00', 'volume_size': 1, 'snapshot_id': '05725813-27b5-4e89-b3e8-5a4e8815a321'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9659b875-4095-4e0d-aa8d-a6b5480e861b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Volume volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 (0a7976ce-cc13-472e-bac5-dc01dbc55f00): created successfully Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9659b875-4095-4e0d-aa8d-a6b5480e861b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Flow 'volume_create_manager' (93f52a26-e58a-45b2-ad89-d3b4f4ce1659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:52:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-87865826-707a-4580-aa51-1c914556e519 tempest-VolumeDependencyTests-1707397108 None] Created volume successfully. Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-05725813-27b5-4e89-b3e8-5a4e8815a321-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-05725813-27b5-4e89-b3e8-5a4e8815a321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-quobyte-4951c2e5-0295-4124-9a60-c0a18a27858a" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-4951c2e5-0295-4124-9a60-c0a18a27858a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-quobyte-05725813-27b5-4e89-b3e8-5a4e8815a321" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-05725813-27b5-4e89-b3e8-5a4e8815a321" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Deleting offline snapshot 05725813-27b5-4e89-b3e8-5a4e8815a321 of volume 4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] snapshot_file for this snap is: volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b1af8-bc0e-4733-b25d-e23d3124d9f3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:05 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 Nov 05 17:52:05 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:05 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321" returned: 0 in 0.463s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4951c2e5-0295-4124-9a60-c0a18a27858a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:52:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[924be4d7-1725-451d-9f43-6111dc59c331]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:05 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a Nov 05 17:52:05 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:06 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a" returned: 0 in 0.563s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:06 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 Nov 05 17:52:06 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:06 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:06 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321 Nov 05 17:52:06 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:06 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a.05725813-27b5-4e89-b3e8-5a4e8815a321" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-05725813-27b5-4e89-b3e8-5a4e8815a321" released by "_delete_snapshot" :: held 1.818s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-4951c2e5-0295-4124-9a60-c0a18a27858a" released by "delete_snapshot" :: held 1.843s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Created reservations ['77291090-2942-426e-9a3c-3524ef584c07', '08a4cdb0-1cf1-4fe7-a902-1b5871269d79', 'ed42bccb-82b0-4ee2-a26c-e78d9f377ea8', 'c7a97ab7-3b1f-44c5-844b-474d8393557e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:52:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Delete snapshot completed successfully. Nov 05 17:52:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7fa1cb-03da-4a26-acc2-750500be71e8 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-05725813-27b5-4e89-b3e8-5a4e8815a321-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-4951c2e5-0295-4124-9a60-c0a18a27858a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-4951c2e5-0295-4124-9a60-c0a18a27858a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-quobyte-4951c2e5-0295-4124-9a60-c0a18a27858a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-4951c2e5-0295-4124-9a60-c0a18a27858a" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f410001a-6f9b-4b62-a83e-b3ebc655cd6c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:07 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a Nov 05 17:52:07 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:07 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:07 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a Nov 05 17:52:07 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:07 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4951c2e5-0295-4124-9a60-c0a18a27858a" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-4951c2e5-0295-4124-9a60-c0a18a27858a" released by "delete_volume" :: held 0.801s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Created reservations ['f5172c37-b0bf-44bb-98b4-39309f2b5dce', 'df2ec12e-c0e6-473c-b663-fe5f221b24c2', '92b24d5d-636e-4ae0-9639-d6e06df4c6fb', '821bd179-d6dc-41bb-a083-0471de92c2dd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:08 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:52:08 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-0a7976ce-cc13-472e-bac5-dc01dbc55f00-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-0a7976ce-cc13-472e-bac5-dc01dbc55f00-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "cinder-quobyte-0a7976ce-cc13-472e-bac5-dc01dbc55f00" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-0a7976ce-cc13-472e-bac5-dc01dbc55f00" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:08 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:52:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Deleted volume successfully. Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecdda42-0d34-4813-874a-c14f50423869]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e9d4ee00-c498-4e68-b33f-8785e345e563 tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-4951c2e5-0295-4124-9a60-c0a18a27858a-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:08 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 Nov 05 17:52:08 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:08 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:08 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00 Nov 05 17:52:08 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:09 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0a7976ce-cc13-472e-bac5-dc01dbc55f00" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-quobyte-0a7976ce-cc13-472e-bac5-dc01dbc55f00" released by "delete_volume" :: held 0.743s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Created reservations ['460bd131-afaa-4281-bc9b-e72fd5159044', 'eadf136c-06cf-48ed-9074-81f41b28fdad', 'be5825a3-381c-44a8-a7f5-2f3cf72cb723', 'bd60274c-2501-4be8-a94e-9f1ce594bad4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:09 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:52:09 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:09 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:52:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Deleted volume successfully. Nov 05 17:52:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5a07aa6-7996-408e-a9c5-e87706fa991c tempest-VolumeDependencyTests-1707397108 None] Lock "cinder-0a7976ce-cc13-472e-bac5-dc01dbc55f00-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Flow 'volume_create_manager' (c5ff7cba-abaa-4db8-a03b-9c846376afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bd61cf-1684-474a-8aa3-aa048d013634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bd61cf-1684-474a-8aa3-aa048d013634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-658480271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a28579-a1a4-4bfd-9697-23937b3fc160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4575e8397921484eb084a6e5b4635c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:52:13Z,use_quota=True,user_id='ba88aa648d4144a690ac7aab0ebcbc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9aaca6-729d-49a0-851d-c0fddc2713a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9aaca6-729d-49a0-851d-c0fddc2713a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f8cf97-d4c7-42c8-8fe8-fa00c6d42d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f8cf97-d4c7-42c8-8fe8-fa00c6d42d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a28579-a1a4-4bfd-9697-23937b3fc160', 'volume_name': 'volume-b3a28579-a1a4-4bfd-9697-23937b3fc160', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1484684-c9a2-4885-998a-f8ce3f750fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1484684-c9a2-4885-998a-f8ce3f750fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400791a9-23c3-4577-99d1-26c330206729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Volume b3a28579-a1a4-4bfd-9697-23937b3fc160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a28579-a1a4-4bfd-9697-23937b3fc160', 'volume_size': 1} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-658480271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a28579-a1a4-4bfd-9697-23937b3fc160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4575e8397921484eb084a6e5b4635c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:52:13Z,use_quota=True,user_id='ba88aa648d4144a690ac7aab0ebcbc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Creating volume b3a28579-a1a4-4bfd-9697-23937b3fc160 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:52:13 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:13 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 1073741824 Nov 05 17:52:13 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:13 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 1073741824" returned: 0 in 0.451s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:13 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 Nov 05 17:52:13 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:13 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:52:13 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:14 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400791a9-23c3-4577-99d1-26c330206729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a28579-a1a4-4bfd-9697-23937b3fc160', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f99bcd-a10f-4e43-84a0-e66614e03a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Volume volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 (b3a28579-a1a4-4bfd-9697-23937b3fc160): created successfully Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f99bcd-a10f-4e43-84a0-e66614e03a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Flow 'volume_create_manager' (c5ff7cba-abaa-4db8-a03b-9c846376afdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:52:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dcf3b050-5e44-46c0-a7cd-aadfa73d9340 tempest-TestImageHashVerification-740930285 None] Created volume successfully. Nov 05 17:52:14 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.322s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:52:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Flow 'volume_create_manager' (3429ab60-d450-420d-ab84-0f15198a263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6f2bc9-7b42-445a-bd19-afe6ac85d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6f2bc9-7b42-445a-bd19-afe6ac85d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85f650b-dd80-48d8-bbce-4501964d3bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496e5b3891a44881affb94bf3dfe3c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:52:15Z,use_quota=True,user_id='3ac74ebeadc845f5b967581d59761b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68da930-df36-41b5-8533-d4524f90df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68da930-df36-41b5-8533-d4524f90df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fe9534-5d99-4052-adbc-9b96ac0ff968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fe9534-5d99-4052-adbc-9b96ac0ff968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c85f650b-dd80-48d8-bbce-4501964d3bc1', 'volume_name': 'volume-c85f650b-dd80-48d8-bbce-4501964d3bc1', 'volume_size': 1, 'image_id': '4de5af34-3058-4166-8687-95b19f20f569', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4de5af34-3058-4166-8687-95b19f20f569', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f7575aeedfd9ad518fc7f4e4906b145', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '496e5b3891a44881affb94bf3dfe3c6d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf373eebceb99aab39b1a31ed675df5b9b434407f62129023bb42492718f8cad071d0188503ee395dfca928d59651c470671e282e0df05a625849e253f92db5d', 'id': '4de5af34-3058-4166-8687-95b19f20f569', 'created_at': datetime.datetime(2026, 11, 5, 16, 52, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 52, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4de5af34-3058-4166-8687-95b19f20f569/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922f6dc8-7347-4b5f-9519-aecd381fb592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922f6dc8-7347-4b5f-9519-aecd381fb592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09c849f-88db-4327-a598-40eeedf0188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Volume c85f650b-dd80-48d8-bbce-4501964d3bc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c85f650b-dd80-48d8-bbce-4501964d3bc1', 'volume_size': 1, 'image_id': '4de5af34-3058-4166-8687-95b19f20f569', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4de5af34-3058-4166-8687-95b19f20f569', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f7575aeedfd9ad518fc7f4e4906b145', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '496e5b3891a44881affb94bf3dfe3c6d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf373eebceb99aab39b1a31ed675df5b9b434407f62129023bb42492718f8cad071d0188503ee395dfca928d59651c470671e282e0df05a625849e253f92db5d', 'id': '4de5af34-3058-4166-8687-95b19f20f569', 'created_at': datetime.datetime(2026, 11, 5, 16, 52, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 52, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4de5af34-3058-4166-8687-95b19f20f569/file', 'properties': {}}, 'image_service': } Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Trying to clone c85f650b-dd80-48d8-bbce-4501964d3bc1 from image 4de5af34-3058-4166-8687-95b19f20f569 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4de5af34-3058-4166-8687-95b19f20f569', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:52:15 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Image download 0.00 MB at 0.00 MB/s Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1cfecd-414f-438d-b797-6358284a6951]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:15 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD Nov 05 17:52:15 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:15 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:16 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD Nov 05 17:52:16 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f80a6-47cc-42d2-8136-64221f0e05a0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:16 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 Nov 05 17:52:16 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:16 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Temporary image 4de5af34-3058-4166-8687-95b19f20f569 is fetched for user 3ac74ebeadc845f5b967581d59761b09. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=107,cinder:UPDATE=110,cinder:DELETE=9,cinder:INSERT=33 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae297908-25ca-4b95-b790-db9b9b338653]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:16 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[25880222-6a1a-4f47-aab2-a2c10c955090]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:16 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD Nov 05 17:52:16 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:16 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 Nov 05 17:52:16 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:16 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:16 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD Nov 05 17:52:16 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:16 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 /opt/stack/data/cinder/conversion/b3a28579-a1a4-4bfd-9697-23937b3fc160.temp_image.da29e9eb-f12d-4704-8067-310ccb0ba41825cgrr74.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:16 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 /opt/stack/data/cinder/conversion/b3a28579-a1a4-4bfd-9697-23937b3fc160.temp_image.da29e9eb-f12d-4704-8067-310ccb0ba41825cgrr74.img Nov 05 17:52:16 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:16 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:52:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:22 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 /opt/stack/data/cinder/conversion/b3a28579-a1a4-4bfd-9697-23937b3fc160.temp_image.da29e9eb-f12d-4704-8067-310ccb0ba41825cgrr74.img" returned: 0 in 5.429s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[352978de-deee-4c05-9783-b94de76042d0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:22 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 Nov 05 17:52:22 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:22 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160" returned: 0 in 0.536s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:22 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/conversion/b3a28579-a1a4-4bfd-9697-23937b3fc160.temp_image.da29e9eb-f12d-4704-8067-310ccb0ba41825cgrr74.img {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:52:22 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Converted 1024.00 MB image at 188.60 MB/s Nov 05 17:52:22 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] da29e9eb-f12d-4704-8067-310ccb0ba418 was raw, no need to convert to raw {{(pid=87126) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 17:52:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=75,cinder:UPDATE=89,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:52:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.350s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Uploaded volume to glance image-id: da29e9eb-f12d-4704-8067-310ccb0ba418. {{(pid=87126) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.399s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85f650b-dd80-48d8-bbce-4501964d3bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496e5b3891a44881affb94bf3dfe3c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:52:15Z,use_quota=True,user_id='3ac74ebeadc845f5b967581d59761b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Creating volume c85f650b-dd80-48d8-bbce-4501964d3bc1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:52:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:41 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 1073741824 Nov 05 17:52:41 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f0595b20-7706-483b-ae22-3c1057847d28 tempest-TestImageHashVerification-740930285 None] Copy volume to image completed successfully. Nov 05 17:52:41 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 1073741824" returned: 0 in 0.449s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:41 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 Nov 05 17:52:41 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:42 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Attempting download of 4de5af34-3058-4166-8687-95b19f20f569 ((None, [{'url': 'file:///opt/stack/data/glance/images/4de5af34-3058-4166-8687-95b19f20f569', 'metadata': {}}])) to volume c85f650b-dd80-48d8-bbce-4501964d3bc1. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0308211b-e7c1-4a67-a855-1e557f20236c]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4de5af34-3058-4166-8687-95b19f20f569_ci0xszb_ {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:42 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4de5af34-3058-4166-8687-95b19f20f569_ci0xszb_ Nov 05 17:52:42 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Acquiring lock "cinder-b3a28579-a1a4-4bfd-9697-23937b3fc160-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Lock "cinder-b3a28579-a1a4-4bfd-9697-23937b3fc160-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Acquiring lock "cinder-quobyte-b3a28579-a1a4-4bfd-9697-23937b3fc160" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Lock "cinder-quobyte-b3a28579-a1a4-4bfd-9697-23937b3fc160" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f5253f-a237-4be8-8558-905965ba9ea2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:42 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4de5af34-3058-4166-8687-95b19f20f569_ci0xszb_" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4de5af34-3058-4166-8687-95b19f20f569_ci0xszb_ {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:42 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 Nov 05 17:52:42 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:42 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4de5af34-3058-4166-8687-95b19f20f569_ci0xszb_ Nov 05 17:52:42 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:42 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4de5af34-3058-4166-8687-95b19f20f569_ci0xszb_" returned: 1 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4de5af34-3058-4166-8687-95b19f20f569_ci0xszb_' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c6b615-dc2c-46fd-bab5-aa5af3f22395]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:42 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:42 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160 Nov 05 17:52:42 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:43 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD Nov 05 17:52:43 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:43 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b3a28579-a1a4-4bfd-9697-23937b3fc160" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Lock "cinder-quobyte-b3a28579-a1a4-4bfd-9697-23937b3fc160" released by "delete_volume" :: held 0.726s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:43 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Created reservations ['676922aa-d3eb-4b5c-9f39-c2b5efb0b89d', '9cd7b795-be85-45fa-9133-56a620fe07d7', 'ae088a19-68d3-46c6-8118-d0bce511f7d0', 'fcaf5245-3839-4aa4-866c-5a60e389655c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:43 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD Nov 05 17:52:43 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:43 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:52:43 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:43 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:43 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] 4de5af34-3058-4166-8687-95b19f20f569 was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:52:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Deleted volume successfully. Nov 05 17:52:43 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 Nov 05 17:52:43 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-54758f94-5541-4fbd-bb98-ac8c15a8f44b tempest-TestImageHashVerification-740930285 None] Lock "cinder-b3a28579-a1a4-4bfd-9697-23937b3fc160-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:44 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1" returned: 0 in 0.499s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4de5af34-3058-4166-8687-95b19f20f569_5tmvu8tbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:52:44 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:44 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 1G Nov 05 17:52:44 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:44 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 1G" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Downloaded image 4de5af34-3058-4166-8687-95b19f20f569 ((None, [{'url': 'file:///opt/stack/data/glance/images/4de5af34-3058-4166-8687-95b19f20f569', 'metadata': {}}])) to volume c85f650b-dd80-48d8-bbce-4501964d3bc1 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Temporary image 4de5af34-3058-4166-8687-95b19f20f569 for user 3ac74ebeadc845f5b967581d59761b09 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Marking volume c85f650b-dd80-48d8-bbce-4501964d3bc1 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Copying metadata from image 4de5af34-3058-4166-8687-95b19f20f569 to c85f650b-dd80-48d8-bbce-4501964d3bc1. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Creating volume glance metadata for volume c85f650b-dd80-48d8-bbce-4501964d3bc1 backed by image 4de5af34-3058-4166-8687-95b19f20f569 with: {'image_id': '4de5af34-3058-4166-8687-95b19f20f569', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4f7575aeedfd9ad518fc7f4e4906b145', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09c849f-88db-4327-a598-40eeedf0188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85f650b-dd80-48d8-bbce-4501964d3bc1', 'volume_size': 1, 'image_id': '4de5af34-3058-4166-8687-95b19f20f569', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4de5af34-3058-4166-8687-95b19f20f569', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f7575aeedfd9ad518fc7f4e4906b145', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '496e5b3891a44881affb94bf3dfe3c6d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf373eebceb99aab39b1a31ed675df5b9b434407f62129023bb42492718f8cad071d0188503ee395dfca928d59651c470671e282e0df05a625849e253f92db5d', 'id': '4de5af34-3058-4166-8687-95b19f20f569', 'created_at': datetime.datetime(2026, 11, 5, 16, 52, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 52, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4de5af34-3058-4166-8687-95b19f20f569/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4298808-5c3f-484c-a2e5-4093ae78f57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Volume volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 (c85f650b-dd80-48d8-bbce-4501964d3bc1): created successfully Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4298808-5c3f-484c-a2e5-4093ae78f57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Flow 'volume_create_manager' (3429ab60-d450-420d-ab84-0f15198a263a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:52:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c79701f2-87d0-402a-a685-7014ae76a0bb tempest-VolumeImageDependencyTests-1834720258 None] Created volume successfully. Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Acquiring lock "cinder-c85f650b-dd80-48d8-bbce-4501964d3bc1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Lock "cinder-c85f650b-dd80-48d8-bbce-4501964d3bc1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Acquiring lock "cinder-quobyte-c85f650b-dd80-48d8-bbce-4501964d3bc1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Lock "cinder-quobyte-c85f650b-dd80-48d8-bbce-4501964d3bc1" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4949a0-7f59-4858-bd12-f62767a92ab2]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:45 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 Nov 05 17:52:45 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:45 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:45 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1 Nov 05 17:52:45 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:45 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c85f650b-dd80-48d8-bbce-4501964d3bc1" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Lock "cinder-quobyte-c85f650b-dd80-48d8-bbce-4501964d3bc1" released by "delete_volume" :: held 0.700s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Created reservations ['fecc5e65-84d7-4b48-ad6c-707a1177f745', '6ad76e0a-abc3-45db-9ff7-d614bec9ed07', '0451349a-7570-4da3-a853-97546167a868', '04939586-184f-47e8-a8c4-c225a0eb285a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:46 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:52:46 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:46 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:52:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Deleted volume successfully. Nov 05 17:52:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b287e630-8bfc-40b4-950a-890442c0cb25 tempest-VolumeImageDependencyTests-1834720258 None] Lock "cinder-c85f650b-dd80-48d8-bbce-4501964d3bc1-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (e476805d-03f0-4ab1-b5e2-2c5a637916e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96adb601-e67c-46c7-bb41-c44de2a439c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96adb601-e67c-46c7-bb41-c44de2a439c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1973207344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c918db2-ee47-434c-8209-9f0acec79887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:52:56Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b95e50d-ead3-4e20-94b4-03cde310201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b95e50d-ead3-4e20-94b4-03cde310201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4787dc1-c44b-4bd3-8f79-f7d6e8a76bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4787dc1-c44b-4bd3-8f79-f7d6e8a76bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c918db2-ee47-434c-8209-9f0acec79887', 'volume_name': 'volume-0c918db2-ee47-434c-8209-9f0acec79887', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ec12e-3288-45b1-9365-c71fd57018ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ec12e-3288-45b1-9365-c71fd57018ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef11aab1-a64d-45e4-9297-82e6a3c96a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume 0c918db2-ee47-434c-8209-9f0acec79887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c918db2-ee47-434c-8209-9f0acec79887', 'volume_size': 1} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1973207344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c918db2-ee47-434c-8209-9f0acec79887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:52:56Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Creating volume 0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:52:56 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:56 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 1073741824 Nov 05 17:52:56 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:56 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 1073741824" returned: 0 in 0.476s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:56 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 Nov 05 17:52:56 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:57 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:52:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:52:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef11aab1-a64d-45e4-9297-82e6a3c96a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c918db2-ee47-434c-8209-9f0acec79887', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be6551c-de4c-437a-a952-f6954905f925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:52:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume volume-0c918db2-ee47-434c-8209-9f0acec79887 (0c918db2-ee47-434c-8209-9f0acec79887): created successfully Nov 05 17:52:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be6551c-de4c-437a-a952-f6954905f925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:52:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (e476805d-03f0-4ab1-b5e2-2c5a637916e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:52:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-52db7dc1-0c93-48f5-8154-7ea9bed22ca6 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created volume successfully. Nov 05 17:52:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:52:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:52:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Creating offline snapshot da73294f-d669-411a-922f-0f5c918e544d of volume 0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:52:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d753438e-450e-406c-b78a-bc6d5787b45d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:52:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:58 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 Nov 05 17:52:58 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:58 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:58 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d 1G Nov 05 17:52:58 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:59 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d 1G" returned: 0 in 0.474s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c918db2-ee47-434c-8209-9f0acec79887 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:59 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c918db2-ee47-434c-8209-9f0acec79887 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d Nov 05 17:52:59 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:59 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c918db2-ee47-434c-8209-9f0acec79887 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:52:59 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d is being set with open permissions: ugo+rw Nov 05 17:52:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:52:59 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d Nov 05 17:52:59 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:52:59 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Nov 05 17:52:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:00 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.info Nov 05 17:53:00 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:00 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.info" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:00 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.info is being set with open permissions: ugo+rw Nov 05 17:53:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:00 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.info Nov 05 17:53:00 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:00 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.info" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ea59bf68-62aa-4dd7-957f-6e913971b81d tempest-CreateVolumesFromSnapshotTest-712079721 None] Create snapshot completed successfully Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (d8e6109d-39aa-4c89-bc7a-12290c1fd46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c611ab7-4c41-4a03-81ac-adb903649c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c611ab7-4c41-4a03-81ac-adb903649c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139851867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2a06dc-acc6-4efa-aa05-fae78acec165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:02Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366d8ec9-8454-4385-9de6-a478c50100a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366d8ec9-8454-4385-9de6-a478c50100a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f478003-2feb-4caf-9fad-02359fb7bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f478003-2feb-4caf-9fad-02359fb7bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a2a06dc-acc6-4efa-aa05-fae78acec165', 'volume_name': 'volume-4a2a06dc-acc6-4efa-aa05-fae78acec165', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3078f24d-4fd2-4e87-9b1d-3dab05aa080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3078f24d-4fd2-4e87-9b1d-3dab05aa080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275e65d3-739d-4fa6-8a30-40f740d84f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume 4a2a06dc-acc6-4efa-aa05-fae78acec165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a2a06dc-acc6-4efa-aa05-fae78acec165', 'volume_size': 1} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139851867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2a06dc-acc6-4efa-aa05-fae78acec165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:02Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Creating volume 4a2a06dc-acc6-4efa-aa05-fae78acec165 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:02 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 1073741824 Nov 05 17:53:02 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (da7ccba8-659e-4af9-b815-02c292b841d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fad6a5-b94e-4f38-8590-cde455356516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fad6a5-b94e-4f38-8590-cde455356516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829432274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7101906e-49f3-40c3-af60-0e81180f3124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:03Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ade4ec-7ce9-4553-bae4-9f7364807a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ade4ec-7ce9-4553-bae4-9f7364807a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f599b922-cf20-4a1a-9b98-d6595b3456e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f599b922-cf20-4a1a-9b98-d6595b3456e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7101906e-49f3-40c3-af60-0e81180f3124', 'volume_name': 'volume-7101906e-49f3-40c3-af60-0e81180f3124', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa297ed7-ed15-4f70-813e-1ea37607c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa297ed7-ed15-4f70-813e-1ea37607c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef5618b-a9ac-4529-8116-752c68573aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume 7101906e-49f3-40c3-af60-0e81180f3124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7101906e-49f3-40c3-af60-0e81180f3124', 'volume_size': 1} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:02 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 1073741824" returned: 0 in 0.643s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:02 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 Nov 05 17:53:02 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (132c7c59-cb24-4532-bd33-f1d2e1863189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11b5be-f111-4f6a-9435-b38e5a3e0bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11b5be-f111-4f6a-9435-b38e5a3e0bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135565275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769c5edd-3f03-4a05-a7f7-e4cdb17d6f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:03Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9291f320-bc7a-49f9-9498-13326c44df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9291f320-bc7a-49f9-9498-13326c44df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4944c6f0-c850-4350-999f-292cca8a9077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4944c6f0-c850-4350-999f-292cca8a9077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769c5edd-3f03-4a05-a7f7-e4cdb17d6f54', 'volume_name': 'volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12838b8-bdba-4ecd-a2d6-63b48fc032a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12838b8-bdba-4ecd-a2d6-63b48fc032a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30165b74-40bb-4ef1-9f6c-b616716221a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume 769c5edd-3f03-4a05-a7f7-e4cdb17d6f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54', 'volume_size': 1} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:03 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829432274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7101906e-49f3-40c3-af60-0e81180f3124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:03Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Creating volume 7101906e-49f3-40c3-af60-0e81180f3124 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:03 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:03 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 1073741824 Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275e65d3-739d-4fa6-8a30-40f740d84f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2a06dc-acc6-4efa-aa05-fae78acec165', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2847a08-7b42-414d-921e-7683e6d9e440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 (4a2a06dc-acc6-4efa-aa05-fae78acec165): created successfully Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2847a08-7b42-414d-921e-7683e6d9e440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (d8e6109d-39aa-4c89-bc7a-12290c1fd46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-33f7af72-940e-40c1-8dbb-221b0954cd87 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created volume successfully. Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (5ac7cdcb-bf95-4151-9f07-85516f632c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c444b1d-eda9-4653-b610-da20713a29e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c444b1d-eda9-4653-b610-da20713a29e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446101292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3e427a-31d9-467d-aac4-715aa1f47beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:03Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189d1791-2850-4b8c-b2d1-f489c85e8a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189d1791-2850-4b8c-b2d1-f489c85e8a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cdb6b3-e949-4cbe-a1da-ec56ff042fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cdb6b3-e949-4cbe-a1da-ec56ff042fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3e427a-31d9-467d-aac4-715aa1f47beb', 'volume_name': 'volume-6d3e427a-31d9-467d-aac4-715aa1f47beb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7b0a25-76d6-45f2-bcc9-a79a420ba301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7b0a25-76d6-45f2-bcc9-a79a420ba301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc87873f-aab2-4b71-bba3-25f06b4d65e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume 6d3e427a-31d9-467d-aac4-715aa1f47beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3e427a-31d9-467d-aac4-715aa1f47beb', 'volume_size': 1} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:03 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 1073741824" returned: 0 in 0.621s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:04 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 Nov 05 17:53:04 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (310b3e7a-6fac-480e-b314-cab30dd06b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a67351-e631-4949-897f-a667040341ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a67351-e631-4949-897f-a667040341ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116901963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a563f2f-c592-474d-8776-6a3f7b66e0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:04Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a021f47-e91e-4654-bb0c-55186e9df5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a021f47-e91e-4654-bb0c-55186e9df5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c641e530-9172-4697-82fa-9f37d72aee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c641e530-9172-4697-82fa-9f37d72aee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a563f2f-c592-474d-8776-6a3f7b66e0d4', 'volume_name': 'volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f85402a-7e08-48e8-8e05-af012443e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f85402a-7e08-48e8-8e05-af012443e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac20729-6bb9-43a7-b8c5-18cd5dbc6b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume 6a563f2f-c592-474d-8776-6a3f7b66e0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4', 'volume_size': 1} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:04 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124" returned: 0 in 0.270s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.071s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135565275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769c5edd-3f03-4a05-a7f7-e4cdb17d6f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:03Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Creating volume 769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:04 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef5618b-a9ac-4529-8116-752c68573aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7101906e-49f3-40c3-af60-0e81180f3124', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:04 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 1073741824 Nov 05 17:53:04 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b128a07-4b86-487d-9008-ff22bf1558ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume volume-7101906e-49f3-40c3-af60-0e81180f3124 (7101906e-49f3-40c3-af60-0e81180f3124): created successfully Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b128a07-4b86-487d-9008-ff22bf1558ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (da7ccba8-659e-4af9-b815-02c292b841d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-25db9e20-a434-4b89-9019-8bd69edeff66 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created volume successfully. Nov 05 17:53:04 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 1073741824" returned: 0 in 0.466s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:04 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 Nov 05 17:53:04 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:05 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446101292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3e427a-31d9-467d-aac4-715aa1f47beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:03Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Creating volume 6d3e427a-31d9-467d-aac4-715aa1f47beb {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:05 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30165b74-40bb-4ef1-9f6c-b616716221a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c7f3e5-9a26-465a-a624-b8b1c86447c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:05 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb 1073741824 Nov 05 17:53:05 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 (769c5edd-3f03-4a05-a7f7-e4cdb17d6f54): created successfully Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c7f3e5-9a26-465a-a624-b8b1c86447c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (132c7c59-cb24-4532-bd33-f1d2e1863189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1e674c16-f9ba-49f3-8be7-e17025993981 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created volume successfully. Nov 05 17:53:05 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb 1073741824" returned: 0 in 0.476s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:05 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb Nov 05 17:53:05 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:05 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116901963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a563f2f-c592-474d-8776-6a3f7b66e0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f3e3860c04eca8bf01f24835f94bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:04Z,use_quota=True,user_id='23a5df486b9044bbac0ae5d2bace304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Creating volume 6a563f2f-c592-474d-8776-6a3f7b66e0d4 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:05 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc87873f-aab2-4b71-bba3-25f06b4d65e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3e427a-31d9-467d-aac4-715aa1f47beb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:05 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 1073741824 Nov 05 17:53:05 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b06b7e-7db9-4ee9-b0bc-20dbf42f9490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume volume-6d3e427a-31d9-467d-aac4-715aa1f47beb (6d3e427a-31d9-467d-aac4-715aa1f47beb): created successfully Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b06b7e-7db9-4ee9-b0bc-20dbf42f9490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (5ac7cdcb-bf95-4151-9f07-85516f632c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c2c2fc4c-5268-4e0e-91e5-424e7b94fd1e tempest-CreateVolumesFromSnapshotTest-712079721 None] Created volume successfully. Nov 05 17:53:06 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 1073741824" returned: 0 in 0.505s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:06 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 Nov 05 17:53:06 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:06 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac20729-6bb9-43a7-b8c5-18cd5dbc6b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4bdf98-1fb5-4084-b5bb-27a2fab4d7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Volume volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 (6a563f2f-c592-474d-8776-6a3f7b66e0d4): created successfully Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4bdf98-1fb5-4084-b5bb-27a2fab4d7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Flow 'volume_create_manager' (310b3e7a-6fac-480e-b314-cab30dd06b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa241950-8208-43f0-a550-3d2c011a720c tempest-CreateVolumesFromSnapshotTest-712079721 None] Created volume successfully. Nov 05 17:53:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-6a563f2f-c592-474d-8776-6a3f7b66e0d4-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-6a563f2f-c592-474d-8776-6a3f7b66e0d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-6a563f2f-c592-474d-8776-6a3f7b66e0d4" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-6a563f2f-c592-474d-8776-6a3f7b66e0d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d332b5bd-3725-4808-a7b3-c8b5ebe56b56]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:07 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 Nov 05 17:53:07 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:08 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:08 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4 Nov 05 17:53:08 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:08 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6a563f2f-c592-474d-8776-6a3f7b66e0d4" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-6a563f2f-c592-474d-8776-6a3f7b66e0d4" released by "delete_volume" :: held 0.692s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created reservations ['095cd5bd-e661-45d4-b20b-04d00d0f09a3', 'a3f0c521-e99c-4153-9f6f-0eaa5540b1dc', 'a86d2847-dbe2-4138-8726-d3ece7896679', 'a9a3c193-5a23-4605-b31a-f88024f8fe7f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:08 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:08 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:08 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Deleted volume successfully. Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-6d3e427a-31d9-467d-aac4-715aa1f47beb-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a12730ad-e571-4d98-9dc4-4c3705e0ddc2 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-6a563f2f-c592-474d-8776-6a3f7b66e0d4-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-6d3e427a-31d9-467d-aac4-715aa1f47beb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-6d3e427a-31d9-467d-aac4-715aa1f47beb" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-6d3e427a-31d9-467d-aac4-715aa1f47beb" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ac6704-957f-4a36-a75b-7f0c07d63177]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:09 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb Nov 05 17:53:09 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:09 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:09 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb Nov 05 17:53:09 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:09 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6d3e427a-31d9-467d-aac4-715aa1f47beb" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-6d3e427a-31d9-467d-aac4-715aa1f47beb" released by "delete_volume" :: held 0.698s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created reservations ['f3a58050-cf49-424b-ad15-a265b8dbd185', '1e887903-00d6-40dc-a360-45332693c7d4', 'daec64d5-926b-4a5d-8518-fcbe02245ea3', '176dad40-41fe-463b-8e6c-333cca944b1b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:09 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:09 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:10 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Deleted volume successfully. Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32df7521-3249-4d94-a2cd-42511a281a01 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-6d3e427a-31d9-467d-aac4-715aa1f47beb-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d85ec-65fc-4928-b683-425637bbdf8f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:10 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 Nov 05 17:53:10 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:10 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:10 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54 Nov 05 17:53:10 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:10 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54" released by "delete_volume" :: held 0.720s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created reservations ['d06eb844-d1ec-494f-ba77-caa4b9da70e4', 'a839cdbc-b89e-46cb-8680-b8260a49d4a0', '884ace7c-6da1-4e13-a061-6654eb9768c6', '13981b7f-43d5-4bc5-bd8b-b6d555a6bdcb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:10 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:10 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-7101906e-49f3-40c3-af60-0e81180f3124-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-7101906e-49f3-40c3-af60-0e81180f3124-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-7101906e-49f3-40c3-af60-0e81180f3124" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:11 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-7101906e-49f3-40c3-af60-0e81180f3124" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Deleted volume successfully. Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf05ae0f-0196-46ee-ad26-560e724cb53c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-22eee6dd-be56-4d30-a6bd-8fccc5cf20e9 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-769c5edd-3f03-4a05-a7f7-e4cdb17d6f54-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:11 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 Nov 05 17:53:11 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:11 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124" returned: 0 in 0.405s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:11 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124 Nov 05 17:53:11 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:11 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7101906e-49f3-40c3-af60-0e81180f3124" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-7101906e-49f3-40c3-af60-0e81180f3124" released by "delete_volume" :: held 0.755s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created reservations ['b213932b-7a22-4d67-abab-5367e17f8389', 'f318b8f1-480a-4afa-be7b-0bc532148141', '277f9b42-1401-4220-b851-a070dd928a9f', '3ad466d0-9ecd-4ed0-9ea5-d12c981b72dc'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:12 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:12 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-4a2a06dc-acc6-4efa-aa05-fae78acec165-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-4a2a06dc-acc6-4efa-aa05-fae78acec165-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-4a2a06dc-acc6-4efa-aa05-fae78acec165" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:12 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Deleted volume successfully. Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-4a2a06dc-acc6-4efa-aa05-fae78acec165" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e15b13c5-61f3-4fe5-9c3e-ad85c4949e92 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-7101906e-49f3-40c3-af60-0e81180f3124-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8202693-bb6a-4c98-aaad-862dc29be242]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:12 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 Nov 05 17:53:12 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:13 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165" returned: 0 in 0.494s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:13 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165 Nov 05 17:53:13 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:13 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4a2a06dc-acc6-4efa-aa05-fae78acec165" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-4a2a06dc-acc6-4efa-aa05-fae78acec165" released by "delete_volume" :: held 0.815s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Created reservations ['c141dfaf-93bf-412d-bf3a-5e1edfacfc97', '69a197c3-ce71-499e-b9e3-0e2dabeda4c8', 'bb0552ad-bbcb-4380-be72-dd23b06ebddb', 'bc0db991-efe8-47dc-982c-a88c3ae296e7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:13 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:13 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-da73294f-d669-411a-922f-0f5c918e544d-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-da73294f-d669-411a-922f-0f5c918e544d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-0c918db2-ee47-434c-8209-9f0acec79887" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-0c918db2-ee47-434c-8209-9f0acec79887" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-da73294f-d669-411a-922f-0f5c918e544d" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-da73294f-d669-411a-922f-0f5c918e544d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Deleting offline snapshot da73294f-d669-411a-922f-0f5c918e544d of volume 0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] snapshot_file for this snap is: volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0475a430-cb41-423e-878f-039f5e2f2204]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:13 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Deleted volume successfully. Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e9a2367-d570-44f5-8fe6-fbbc6b8c81fa tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-4a2a06dc-acc6-4efa-aa05-fae78acec165-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:13 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d Nov 05 17:53:13 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Flow 'volume_create_manager' (0bf9f007-e51e-4051-ad02-38abb354813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb6cb92-67e1-424b-a9dc-c24820fa43f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb6cb92-67e1-424b-a9dc-c24820fa43f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-885936368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b15060c-4e60-4646-a194-aa1b0b413eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb085f35184f1a80f6edd0346ab446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:14Z,use_quota=True,user_id='f68cf6cc78854eaaa02c82b8cacdd9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:13 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:13 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45880e65-27ff-46a8-a306-b3cffe03d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45880e65-27ff-46a8-a306-b3cffe03d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab4eb81-f29c-4458-afb2-ada31513a1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab4eb81-f29c-4458-afb2-ada31513a1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b15060c-4e60-4646-a194-aa1b0b413eb1', 'volume_name': 'volume-6b15060c-4e60-4646-a194-aa1b0b413eb1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541fa8d3-a7b6-4721-a32e-10626117efe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541fa8d3-a7b6-4721-a32e-10626117efe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ec3d7f-2f87-4cde-8f55-80f18715cf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Volume 6b15060c-4e60-4646-a194-aa1b0b413eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b15060c-4e60-4646-a194-aa1b0b413eb1', 'volume_size': 1} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-885936368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b15060c-4e60-4646-a194-aa1b0b413eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb085f35184f1a80f6edd0346ab446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:14Z,use_quota=True,user_id='f68cf6cc78854eaaa02c82b8cacdd9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Creating volume 6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:13 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:13 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 1073741824 Nov 05 17:53:13 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:14 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d" returned: 0 in 0.424s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c918db2-ee47-434c-8209-9f0acec79887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24705d4-6d0b-472b-bfa8-4cf7f4a631a0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:14 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:53:14 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 Nov 05 17:53:14 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:14 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 1073741824" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:14 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 Nov 05 17:53:14 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:14 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:14 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d Nov 05 17:53:14 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:14 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ec3d7f-2f87-4cde-8f55-80f18715cf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b15060c-4e60-4646-a194-aa1b0b413eb1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef9189-a9a3-44f3-b041-47b4b1a54011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Volume volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 (6b15060c-4e60-4646-a194-aa1b0b413eb1): created successfully Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef9189-a9a3-44f3-b041-47b4b1a54011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Flow 'volume_create_manager' (0bf9f007-e51e-4051-ad02-38abb354813e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-29ecb995-99f6-43ea-8f0d-35b7416df325 tempest-SnapshotDependencyTests-2076751646 None] Created volume successfully. Nov 05 17:53:14 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:14 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d Nov 05 17:53:14 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:15 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887.da73294f-d669-411a-922f-0f5c918e544d" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-da73294f-d669-411a-922f-0f5c918e544d" released by "_delete_snapshot" :: held 1.488s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-0c918db2-ee47-434c-8209-9f0acec79887" released by "delete_snapshot" :: held 1.512s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Created reservations ['178c3373-8762-4258-b641-9f68936e61c6', 'c6356f6d-6846-4944-b051-4492498ed86b', '1c370844-d8cc-47b4-8842-6618b7743e1d', 'd52f35fc-0af4-4690-87cc-70e29da88555'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Delete snapshot completed successfully. Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eb773fb7-cd64-45b3-8313-6b94b54359fe tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-da73294f-d669-411a-922f-0f5c918e544d-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-0c918db2-ee47-434c-8209-9f0acec79887-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-0c918db2-ee47-434c-8209-9f0acec79887-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "cinder-quobyte-0c918db2-ee47-434c-8209-9f0acec79887" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-0c918db2-ee47-434c-8209-9f0acec79887" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c551b79e-6e53-4068-9a9b-8a39b6ff3249]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:15 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 Nov 05 17:53:15 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Creating offline snapshot 2641fbc6-7c0a-4d5a-9b65-e0934837c493 of volume 6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b77140-1c82-423f-9bb3-cfd75d0137c4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:16 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:16 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887 Nov 05 17:53:16 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:16 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 Nov 05 17:53:16 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:16 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0c918db2-ee47-434c-8209-9f0acec79887" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-quobyte-0c918db2-ee47-434c-8209-9f0acec79887" released by "delete_volume" :: held 0.692s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Created reservations ['ac82a80d-e66f-4009-9ae8-428c816e946d', '74761461-fae2-4e78-8634-f4d4b91a6176', '65af3ded-8002-49de-946b-4a0b2d749710', 'fa9649c9-b218-473d-9840-1eddf5c4b0f2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:16 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:16 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 1G Nov 05 17:53:16 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:16 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:16 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:16 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Deleted volume successfully. Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04eddb93-b8a2-4f56-a45a-fd865f401959 tempest-CreateVolumesFromSnapshotTest-712079721 None] Lock "cinder-0c918db2-ee47-434c-8209-9f0acec79887-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:16 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 1G" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:16 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 Nov 05 17:53:16 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:17 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493" returned: 0 in 0.294s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:17 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 is being set with open permissions: ugo+rw Nov 05 17:53:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:17 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 Nov 05 17:53:17 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:17 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:17 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.info Nov 05 17:53:17 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:17 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.info" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:17 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.info is being set with open permissions: ugo+rw Nov 05 17:53:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:17 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.info Nov 05 17:53:17 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:18 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.info" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-694afba6-b361-4134-b265-3face96e4b14 tempest-SnapshotDependencyTests-2076751646 None] Create snapshot completed successfully Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Flow 'volume_create_manager' (5ca818b9-e2a7-4241-8f05-f0c8f16a8937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf3363e-cf47-49d8-9713-0cfa754c25ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf3363e-cf47-49d8-9713-0cfa754c25ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6556ef7-cf59-48ef-810c-9efe2d8cbc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb085f35184f1a80f6edd0346ab446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2641fbc6-7c0a-4d5a-9b65-e0934837c493,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:19Z,use_quota=True,user_id='f68cf6cc78854eaaa02c82b8cacdd9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f81ea-8490-40f4-b2c3-c3ac02c43ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f81ea-8490-40f4-b2c3-c3ac02c43ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27249e77-c446-4790-a671-1483af8bac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27249e77-c446-4790-a671-1483af8bac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6556ef7-cf59-48ef-810c-9efe2d8cbc2a', 'volume_name': 'volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a', 'volume_size': 1, 'snapshot_id': '2641fbc6-7c0a-4d5a-9b65-e0934837c493'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85378c71-ccb8-4aaf-8dcd-b84200dbf553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85378c71-ccb8-4aaf-8dcd-b84200dbf553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f0109e-d2e3-450b-96e8-a4967791e94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Volume a6556ef7-cf59-48ef-810c-9efe2d8cbc2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a', 'volume_size': 1, 'snapshot_id': '2641fbc6-7c0a-4d5a-9b65-e0934837c493'} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-quobyte-2641fbc6-7c0a-4d5a-9b65-e0934837c493-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-2641fbc6-7c0a-4d5a-9b65-e0934837c493-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Creating volume a6556ef7-cf59-48ef-810c-9efe2d8cbc2a from snapshot 2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-quobyte-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] snapshot: 2641fbc6-7c0a-4d5a-9b65-e0934837c493, volume: a6556ef7-cf59-48ef-810c-9efe2d8cbc2a, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d789cc2d-edc1-48f2-915e-c95db0039956]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:19 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 Nov 05 17:53:19 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:19 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b15060c-4e60-4646-a194-aa1b0b413eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbc2b54-2f9b-451b-ae58-64c24ff3c155]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:19 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 Nov 05 17:53:19 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:19 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:53:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:19 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a Nov 05 17:53:19 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:25 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" returned: 0 in 5.550s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:53:25 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Converted 1024.00 MB image at 184.45 MB/s Nov 05 17:53:25 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a is being set with open permissions: ugo+rw Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:25 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a Nov 05 17:53:25 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:25 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" returned: 0 in 0.227s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" released by "_copy_volume_from_snapshot" :: held 6.608s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-2641fbc6-7c0a-4d5a-9b65-e0934837c493-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" released by "_create_volume_from_snapshot" :: held 6.663s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.678s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f0109e-d2e3-450b-96e8-a4967791e94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a', 'volume_size': 1, 'snapshot_id': '2641fbc6-7c0a-4d5a-9b65-e0934837c493'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75e3cb8-3ec8-497a-a20c-a680a8150a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Volume volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a (a6556ef7-cf59-48ef-810c-9efe2d8cbc2a): created successfully Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75e3cb8-3ec8-497a-a20c-a680a8150a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Flow 'volume_create_manager' (5ca818b9-e2a7-4241-8f05-f0c8f16a8937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-09bbbd47-bf69-4339-8452-fc509cd96f34 tempest-SnapshotDependencyTests-2076751646 None] Created volume successfully. Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-2641fbc6-7c0a-4d5a-9b65-e0934837c493-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-2641fbc6-7c0a-4d5a-9b65-e0934837c493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-quobyte-6b15060c-4e60-4646-a194-aa1b0b413eb1" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-6b15060c-4e60-4646-a194-aa1b0b413eb1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-quobyte-2641fbc6-7c0a-4d5a-9b65-e0934837c493" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-2641fbc6-7c0a-4d5a-9b65-e0934837c493" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Deleting offline snapshot 2641fbc6-7c0a-4d5a-9b65-e0934837c493 of volume 6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] snapshot_file for this snap is: volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80d3182-8ba0-4bfd-8a16-d5633489485d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:26 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 Nov 05 17:53:26 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:26 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b15060c-4e60-4646-a194-aa1b0b413eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[be760bb8-0c72-4fc4-9773-788513585068]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:26 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 Nov 05 17:53:26 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:27 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:27 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 Nov 05 17:53:27 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:27 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:27 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493 Nov 05 17:53:27 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:27 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1.2641fbc6-7c0a-4d5a-9b65-e0934837c493" returned: 0 in 0.234s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-2641fbc6-7c0a-4d5a-9b65-e0934837c493" released by "_delete_snapshot" :: held 1.478s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-6b15060c-4e60-4646-a194-aa1b0b413eb1" released by "delete_snapshot" :: held 1.500s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Created reservations ['8c5b76be-9409-4967-8fad-fb68d185c1a7', '9afccbdb-5efa-42ff-bc7b-08cda29b9dce', '9379a094-e776-4fe5-9860-f999e4fa46cc', 'd8ae3048-4de3-4580-9872-39dc354dc166'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Delete snapshot completed successfully. Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cef49709-d2b5-46dc-b171-cf2ce9ca596d tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-2641fbc6-7c0a-4d5a-9b65-e0934837c493-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-6b15060c-4e60-4646-a194-aa1b0b413eb1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-6b15060c-4e60-4646-a194-aa1b0b413eb1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-quobyte-6b15060c-4e60-4646-a194-aa1b0b413eb1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-6b15060c-4e60-4646-a194-aa1b0b413eb1" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9387a2-a439-4080-906c-5fa4953ca6e7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:28 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 Nov 05 17:53:28 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:28 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:28 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1 Nov 05 17:53:28 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:29 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6b15060c-4e60-4646-a194-aa1b0b413eb1" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-6b15060c-4e60-4646-a194-aa1b0b413eb1" released by "delete_volume" :: held 0.626s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Created reservations ['f234bf0a-bbc9-4c79-856e-22fbbff27fb0', '9305160a-13e4-4198-957b-904418e98aad', '6c469d84-1e8e-4dde-8b2a-3debe444cc81', 'bfeca035-4d83-4dcf-b3d6-a93a8fb74420'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:29 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:29 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:29 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.230s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Deleted volume successfully. Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f24f68f-6a1d-46d1-98b9-045dd03d564f tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-6b15060c-4e60-4646-a194-aa1b0b413eb1-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "cinder-quobyte-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf1d49b-200c-4b04-9f25-0be39207a37e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:29 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a Nov 05 17:53:29 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:30 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:30 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a Nov 05 17:53:30 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:30 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-quobyte-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a" released by "delete_volume" :: held 0.611s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Created reservations ['6ccf6494-0c4c-4660-9388-32e6e04a62b3', '151d30e1-5919-41f7-9962-b934b813d3fc', '703b3337-3fa1-4b96-a962-0fe30c61f12f', '2d50cf57-cce5-4c55-8c75-193870bbef11'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:30 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:30 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:30 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.231s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Deleted volume successfully. Nov 05 17:53:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62ce877e-bef2-4386-bf6a-31e3afe577bd tempest-SnapshotDependencyTests-2076751646 None] Lock "cinder-a6556ef7-cf59-48ef-810c-9efe2d8cbc2a-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:40 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=137,cinder:SELECT=88,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:53:40 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=77,cinder:UPDATE=90,cinder:DELETE=10,cinder:INSERT=28 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (aee59514-0af9-49b3-ab02-2a9d29d10ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac0c6c4-1f00-4d36-82cb-8e65a140844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac0c6c4-1f00-4d36-82cb-8e65a140844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342944965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd311f1-f88f-478b-8e12-a8023cde90f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:51Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbaa5b3-65a7-4f3d-800f-b1992124ac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbaa5b3-65a7-4f3d-800f-b1992124ac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe1b63a-da16-4158-87ab-392dc3127111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe1b63a-da16-4158-87ab-392dc3127111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd311f1-f88f-478b-8e12-a8023cde90f8', 'volume_name': 'volume-0fd311f1-f88f-478b-8e12-a8023cde90f8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835d8981-3362-4f26-80be-6f8b1756194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835d8981-3362-4f26-80be-6f8b1756194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c2eab8-2700-4775-a6e3-08901772b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume 0fd311f1-f88f-478b-8e12-a8023cde90f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd311f1-f88f-478b-8e12-a8023cde90f8', 'volume_size': 1} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342944965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd311f1-f88f-478b-8e12-a8023cde90f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:51Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Creating volume 0fd311f1-f88f-478b-8e12-a8023cde90f8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:51 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:51 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 1073741824 Nov 05 17:53:51 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (9ad4f9b1-88e0-4b11-9a45-c32f78fd8d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb628912-8568-4935-aef4-dcf6fd2f10a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb628912-8568-4935-aef4-dcf6fd2f10a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1909983766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6e3762-a386-41bf-b97f-54b7ffb017fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:51Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271cb542-0f3b-415c-9a66-80630cfa1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271cb542-0f3b-415c-9a66-80630cfa1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64e1946-1809-40c4-89f1-d474d0f65ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64e1946-1809-40c4-89f1-d474d0f65ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf6e3762-a386-41bf-b97f-54b7ffb017fc', 'volume_name': 'volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e3d41b-cc16-4e81-855f-4be23dc19af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e3d41b-cc16-4e81-855f-4be23dc19af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990ecfce-300a-4b50-a7f8-d1fecda7adc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Volume bf6e3762-a386-41bf-b97f-54b7ffb017fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc', 'volume_size': 1} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (bb3748ab-ac62-438b-811f-81042f4c7342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39d0fc0-4763-4d4a-b00e-b0c038686633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39d0fc0-4763-4d4a-b00e-b0c038686633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2011710877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d250e576-354f-4255-a543-ed333c522f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:52Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddbd17c-f3ee-4e3a-8ed7-8186c28f037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddbd17c-f3ee-4e3a-8ed7-8186c28f037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f69755c-a02e-4f7b-81df-5824b045a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f69755c-a02e-4f7b-81df-5824b045a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd250e576-354f-4255-a543-ed333c522f64', 'volume_name': 'volume-d250e576-354f-4255-a543-ed333c522f64', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8007e23-2b98-43f9-b2ad-7a5f359abdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8007e23-2b98-43f9-b2ad-7a5f359abdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6776367-ae59-4ca3-b823-c4b3884753f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Volume d250e576-354f-4255-a543-ed333c522f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d250e576-354f-4255-a543-ed333c522f64', 'volume_size': 1} Nov 05 17:53:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:52 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 1073741824" returned: 0 in 0.711s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:52 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 Nov 05 17:53:52 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:52 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1909983766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6e3762-a386-41bf-b97f-54b7ffb017fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:51Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Creating volume bf6e3762-a386-41bf-b97f-54b7ffb017fc {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:52 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c2eab8-2700-4775-a6e3-08901772b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd311f1-f88f-478b-8e12-a8023cde90f8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:52 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc 1073741824 Nov 05 17:53:52 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea78e1-7bdf-4438-b1fa-2fcf998f903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (b1cdc59a-97b0-4987-bf75-b7fbf3a37ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6134a4-342d-403a-975c-7d0a17eaee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 (0fd311f1-f88f-478b-8e12-a8023cde90f8): created successfully Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea78e1-7bdf-4438-b1fa-2fcf998f903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (aee59514-0af9-49b3-ab02-2a9d29d10ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6134a4-342d-403a-975c-7d0a17eaee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809568231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c6ec96-2c14-479a-a0ba-0e773af0ec02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:52Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ee0e8c-0eba-44e9-bcfa-1903d559232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ee0e8c-0eba-44e9-bcfa-1903d559232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e345d8-5cc4-4304-982e-e4892748f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e345d8-5cc4-4304-982e-e4892748f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c6ec96-2c14-479a-a0ba-0e773af0ec02', 'volume_name': 'volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e46a5-9bbb-42fb-9038-4021b2bcd79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e46a5-9bbb-42fb-9038-4021b2bcd79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ef7510-4351-41dd-8638-c6f57854f83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Volume a4c6ec96-2c14-479a-a0ba-0e773af0ec02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02', 'volume_size': 1} Nov 05 17:53:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f4830b16-e234-46a2-9084-7dcccfd74e2c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created volume successfully. Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (703ecf45-b18a-44aa-a24a-8f94d46a0e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f01c2a7-6a73-4485-9f26-01bce9761085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f01c2a7-6a73-4485-9f26-01bce9761085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2132679839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c33dde2-429a-4a81-8b13-00297015f941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:53Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea33115-3c41-4fd0-8473-2721caf479c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea33115-3c41-4fd0-8473-2721caf479c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9871460-b115-4ae0-931b-0216bd0f6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9871460-b115-4ae0-931b-0216bd0f6b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c33dde2-429a-4a81-8b13-00297015f941', 'volume_name': 'volume-7c33dde2-429a-4a81-8b13-00297015f941', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38cc7d7-6e03-42ab-a99a-1bd40c4113cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38cc7d7-6e03-42ab-a99a-1bd40c4113cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18559381-77f3-472d-b7d3-a2ff6e44054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Volume 7c33dde2-429a-4a81-8b13-00297015f941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c33dde2-429a-4a81-8b13-00297015f941', 'volume_size': 1} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:53 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc 1073741824" returned: 0 in 0.694s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:53 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc Nov 05 17:53:53 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:53 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2011710877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d250e576-354f-4255-a543-ed333c522f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:52Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Creating volume d250e576-354f-4255-a543-ed333c522f64 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:53 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (3392a7e9-69a6-4ac9-8d1a-b378173553fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0834e3-bc0d-488e-93c4-6da0d369dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 1073741824 Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990ecfce-300a-4b50-a7f8-d1fecda7adc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bdb662-4add-434f-978e-5b248b1a1a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0834e3-bc0d-488e-93c4-6da0d369dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-385631742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a69223b-1729-4aa4-ba57-a36b335a50a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:53Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13787cf-4850-4819-9ef8-924a9396b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13787cf-4850-4819-9ef8-924a9396b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c11930-865b-4a80-8389-47e8b2b23bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c11930-865b-4a80-8389-47e8b2b23bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a69223b-1729-4aa4-ba57-a36b335a50a3', 'volume_name': 'volume-8a69223b-1729-4aa4-ba57-a36b335a50a3', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a23401b-1a6d-4b7f-b2d2-2fc5ade6041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a23401b-1a6d-4b7f-b2d2-2fc5ade6041d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71722f50-37a0-4cd9-906e-cb3d3d75583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Volume 8a69223b-1729-4aa4-ba57-a36b335a50a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a69223b-1729-4aa4-ba57-a36b335a50a3', 'volume_size': 1} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Volume volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc (bf6e3762-a386-41bf-b97f-54b7ffb017fc): created successfully Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bdb662-4add-434f-978e-5b248b1a1a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (9ad4f9b1-88e0-4b11-9a45-c32f78fd8d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-482098ce-dd86-409f-a1ce-b7bb2541e650 tempest-CreateVolumesFromImageTest-1198822146 None] Created volume successfully. Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (2d823d5c-ba7f-476c-85a9-d3ba2ec0cabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33bdb64-5e37-4fde-9ae5-5f35543b0ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33bdb64-5e37-4fde-9ae5-5f35543b0ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11907580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7dc4e5-c287-4a34-8623-46b6ae1186c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:54Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d9e11-5d06-4787-9f2e-9ad8021e0c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d9e11-5d06-4787-9f2e-9ad8021e0c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75418cc-6ebb-47c3-9aa7-f3462177a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75418cc-6ebb-47c3-9aa7-f3462177a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7dc4e5-c287-4a34-8623-46b6ae1186c1', 'volume_name': 'volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5899ba-536d-44d4-9bf2-b4b134305af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5899ba-536d-44d4-9bf2-b4b134305af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5d99aa-cf98-4604-8dd0-727f35fa5eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume 8c7dc4e5-c287-4a34-8623-46b6ae1186c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1', 'volume_size': 1} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:54 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 1073741824" returned: 0 in 0.794s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:54 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 Nov 05 17:53:54 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:54 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.129s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809568231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c6ec96-2c14-479a-a0ba-0e773af0ec02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:52Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Creating volume a4c6ec96-2c14-479a-a0ba-0e773af0ec02 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:54 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:54 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 1073741824 Nov 05 17:53:54 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6776367-ae59-4ca3-b823-c4b3884753f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d250e576-354f-4255-a543-ed333c522f64', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94bc47e-0037-4fc5-a75f-91a8aefc696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Volume volume-d250e576-354f-4255-a543-ed333c522f64 (d250e576-354f-4255-a543-ed333c522f64): created successfully Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94bc47e-0037-4fc5-a75f-91a8aefc696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (bb3748ab-ac62-438b-811f-81042f4c7342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cf21db16-3978-4376-a4f2-798d0a8df9a9 tempest-CreateVolumesFromImageTest-1198822146 None] Created volume successfully. Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Flow 'volume_create_manager' (5f91716f-0787-417f-a8cd-43f9c73a79ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb87418-a85a-4155-8fcd-b5c97fc7f460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb87418-a85a-4155-8fcd-b5c97fc7f460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9880071-b90f-432f-8afe-beadf67c9b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f26a0c96b094e328568960aae20e4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:55Z,use_quota=True,user_id='b943cde146294cc1982aa6d95d2fb4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055d4d1c-398f-4289-8d32-1e2fcb722164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055d4d1c-398f-4289-8d32-1e2fcb722164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0c307d-d2f5-47d2-ae80-27fa9a2f3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:53:55 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 1073741824" returned: 0 in 0.639s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (4fe3ff40-f910-421e-ae67-f01a732251e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b30375e-938d-4ef8-ac06-4249a30f90df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (45adbf3f-9d20-420b-a819-1d893f86b4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca97019a-c1db-4aa6-9400-6d65f7b7230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b30375e-938d-4ef8-ac06-4249a30f90df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126297571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c57ee21-76c5-46a7-8277-f2cfa4c9b803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:55Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee4f232-39ea-4567-a10b-4bdf31688011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee4f232-39ea-4567-a10b-4bdf31688011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43536680-acef-4489-8df7-24477a4c569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43536680-acef-4489-8df7-24477a4c569b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c57ee21-76c5-46a7-8277-f2cfa4c9b803', 'volume_name': 'volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b07392e-6345-4e0c-b544-d2c857dbf03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b07392e-6345-4e0c-b544-d2c857dbf03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2d585b-1290-41ce-a04a-2da15efbf53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume 8c57ee21-76c5-46a7-8277-f2cfa4c9b803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803', 'volume_size': 1} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca97019a-c1db-4aa6-9400-6d65f7b7230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1028567108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ae79d-35b1-4b81-8d5b-a83550a97549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:55Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354220b7-e92d-4300-bada-cad9c5351aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354220b7-e92d-4300-bada-cad9c5351aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8cdf52-d74d-4cd8-8efe-ee72167aa822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8cdf52-d74d-4cd8-8efe-ee72167aa822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8ae79d-35b1-4b81-8d5b-a83550a97549', 'volume_name': 'volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff8b731-b523-44cf-9c16-e9695a0b0a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff8b731-b523-44cf-9c16-e9695a0b0a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237479d4-bc84-4c69-a9db-c4a6e1cf8c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume 2a8ae79d-35b1-4b81-8d5b-a83550a97549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549', 'volume_size': 1} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:55 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 Nov 05 17:53:55 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (3d2f4531-c373-4935-9644-bac0012bb7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e03ae8-6b7c-426a-8dd5-e8b4f3d4b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e03ae8-6b7c-426a-8dd5-e8b4f3d4b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1504697203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7374038-f9d1-4d69-a05f-67ed7d28fe18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:56Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6d5cb9-3eb9-4802-a42f-ad29949a9f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6d5cb9-3eb9-4802-a42f-ad29949a9f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cf61ad-fee4-4c94-b434-29ad89f6dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cf61ad-fee4-4c94-b434-29ad89f6dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7374038-f9d1-4d69-a05f-67ed7d28fe18', 'volume_name': 'volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe40fb8a-2e42-4b49-b07e-46d3d5d0b582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe40fb8a-2e42-4b49-b07e-46d3d5d0b582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827afbe0-dd6c-4dad-9eb1-9a8bbf7e86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume f7374038-f9d1-4d69-a05f-67ed7d28fe18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18', 'volume_size': 1} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:56 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02" returned: 0 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.951s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2132679839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c33dde2-429a-4a81-8b13-00297015f941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:53Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Creating volume 7c33dde2-429a-4a81-8b13-00297015f941 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:56 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ef7510-4351-41dd-8638-c6f57854f83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 1073741824 Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f9e73e-52e1-49f8-9047-2b516fe38008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0c307d-d2f5-47d2-ae80-27fa9a2f3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9880071-b90f-432f-8afe-beadf67c9b87', 'volume_name': 'volume-e9880071-b90f-432f-8afe-beadf67c9b87', 'volume_size': 1, 'image_id': '801481be-0420-4e94-852c-68765b886406', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801481be-0420-4e94-852c-68765b886406', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c52dfc8832887500915278aa950da839', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f26a0c96b094e328568960aae20e4db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '432a38d925139a7a8dd95f5d31f781b81bc70c46dd114543562b4da0418d74e242dde40e8e3c06a517aa338f1e7456c69489c082798cc7121b7f12419dd88d23', 'id': '801481be-0420-4e94-852c-68765b886406', 'created_at': datetime.datetime(2026, 11, 5, 16, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801481be-0420-4e94-852c-68765b886406/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43b662-d38d-46dd-8991-61ec0e15ac7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43b662-d38d-46dd-8991-61ec0e15ac7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1ea8fc-86e6-46ac-8b3a-2102c7f33be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Volume e9880071-b90f-432f-8afe-beadf67c9b87: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9880071-b90f-432f-8afe-beadf67c9b87', 'volume_size': 1, 'image_id': '801481be-0420-4e94-852c-68765b886406', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801481be-0420-4e94-852c-68765b886406', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c52dfc8832887500915278aa950da839', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f26a0c96b094e328568960aae20e4db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '432a38d925139a7a8dd95f5d31f781b81bc70c46dd114543562b4da0418d74e242dde40e8e3c06a517aa338f1e7456c69489c082798cc7121b7f12419dd88d23', 'id': '801481be-0420-4e94-852c-68765b886406', 'created_at': datetime.datetime(2026, 11, 5, 16, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801481be-0420-4e94-852c-68765b886406/file', 'properties': {}}, 'image_service': } Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Trying to clone e9880071-b90f-432f-8afe-beadf67c9b87 from image 801481be-0420-4e94-852c-68765b886406 at location (None, [{'url': 'file:///opt/stack/data/glance/images/801481be-0420-4e94-852c-68765b886406', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:53:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Volume volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 (a4c6ec96-2c14-479a-a0ba-0e773af0ec02): created successfully Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f9e73e-52e1-49f8-9047-2b516fe38008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (b1cdc59a-97b0-4987-bf75-b7fbf3a37ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5c3b6b53-4c44-4880-92d9-1c4af194ec5c tempest-CreateVolumesFromImageTest-1198822146 None] Created volume successfully. Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (cb6963bf-f12e-427f-83e4-e9160e219014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934cddc1-643d-40a4-87b9-379dbeb59abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934cddc1-643d-40a4-87b9-379dbeb59abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839932850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21daae47-577c-438d-b41c-220381373aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:56Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed2ac7d-af7b-4c41-896f-76d57bf31e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed2ac7d-af7b-4c41-896f-76d57bf31e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3493591c-18c1-4740-a64c-bbce6fd7407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3493591c-18c1-4740-a64c-bbce6fd7407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21daae47-577c-438d-b41c-220381373aa2', 'volume_name': 'volume-21daae47-577c-438d-b41c-220381373aa2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27a20a2-2f54-459c-8654-f557e483563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27a20a2-2f54-459c-8654-f557e483563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3866e8f5-0613-4fdd-97d1-e92c6ea7a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume 21daae47-577c-438d-b41c-220381373aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21daae47-577c-438d-b41c-220381373aa2', 'volume_size': 1} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:53:56 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Image download 0.00 MB at 0.00 MB/s Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50f540-3c97-44f5-9558-2cc6c0ae74e7]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:56 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD Nov 05 17:53:56 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:56 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 1073741824" returned: 0 in 0.571s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:56 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 Nov 05 17:53:56 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Flow 'volume_create_manager' (96643538-57bb-4811-b5c9-23c19612703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:56 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69e4eff-93a5-4910-95d9-b248e3f05fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69e4eff-93a5-4910-95d9-b248e3f05fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dde96a-ea81-4318-8c7c-92b10a4650fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f84d34f63754de5bc1572faa3b48ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:57Z,use_quota=True,user_id='f37f997741004453969d9b2186bdfadb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(162ad151-1b60-41d7-83d0-80a924c88acf),volume_type_id=162ad151-1b60-41d7-83d0-80a924c88acf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55da06be-360b-4460-baa5-89596a39f1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55da06be-360b-4460-baa5-89596a39f1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c7f41-941a-4ad9-8dfe-d40fc58bb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:56 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 17:53:57 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD Nov 05 17:53:57 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.304s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-385631742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a69223b-1729-4aa4-ba57-a36b335a50a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3424e8cbc24d45018cd37a052009ed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:53Z,use_quota=True,user_id='e3e4932ebdec467a896391792a1955b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Creating volume 8a69223b-1729-4aa4-ba57-a36b335a50a3 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:57 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 1073741824 Nov 05 17:53:57 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18559381-77f3-472d-b7d3-a2ff6e44054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c33dde2-429a-4a81-8b13-00297015f941', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be718321-980a-497f-a472-938d635d4dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Volume volume-7c33dde2-429a-4a81-8b13-00297015f941 (7c33dde2-429a-4a81-8b13-00297015f941): created successfully Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be718321-980a-497f-a472-938d635d4dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (703ecf45-b18a-44aa-a24a-8f94d46a0e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6baac6fc-1129-4737-985f-e3a8c90b5396 tempest-CreateVolumesFromImageTest-1198822146 None] Created volume successfully. Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c7f41-941a-4ad9-8dfe-d40fc58bb26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21dde96a-ea81-4318-8c7c-92b10a4650fe', 'volume_name': 'volume-21dde96a-ea81-4318-8c7c-92b10a4650fe', 'volume_size': 1, 'image_id': '6388b874-f100-48a8-b9ff-171ca14ca799', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6388b874-f100-48a8-b9ff-171ca14ca799', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '071e75ee15651b3e50b04deff6a3b7d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f84d34f63754de5bc1572faa3b48ef3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69a545c30e4adfcfba8f7da142d509fdf36be6bb966cf74f527ea797103ea11b6886fb53d7a80bb8cdeb2d2b79e1175b664843c2367be6007edcb30b5f09535f', 'id': '6388b874-f100-48a8-b9ff-171ca14ca799', 'created_at': datetime.datetime(2026, 11, 5, 16, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 53, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6388b874-f100-48a8-b9ff-171ca14ca799/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d920f45f-d1e9-40fc-8563-22d4afe5858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d920f45f-d1e9-40fc-8563-22d4afe5858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d42c6a-1ffc-405b-a32f-6872211b3d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Volume 21dde96a-ea81-4318-8c7c-92b10a4650fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21dde96a-ea81-4318-8c7c-92b10a4650fe', 'volume_size': 1, 'image_id': '6388b874-f100-48a8-b9ff-171ca14ca799', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6388b874-f100-48a8-b9ff-171ca14ca799', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '071e75ee15651b3e50b04deff6a3b7d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f84d34f63754de5bc1572faa3b48ef3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69a545c30e4adfcfba8f7da142d509fdf36be6bb966cf74f527ea797103ea11b6886fb53d7a80bb8cdeb2d2b79e1175b664843c2367be6007edcb30b5f09535f', 'id': '6388b874-f100-48a8-b9ff-171ca14ca799', 'created_at': datetime.datetime(2026, 11, 5, 16, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 53, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6388b874-f100-48a8-b9ff-171ca14ca799/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Trying to clone 21dde96a-ea81-4318-8c7c-92b10a4650fe from image 6388b874-f100-48a8-b9ff-171ca14ca799 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6388b874-f100-48a8-b9ff-171ca14ca799', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 17:53:57 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Temporary image 801481be-0420-4e94-852c-68765b886406 is fetched for user b943cde146294cc1982aa6d95d2fb4d8. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a9d2c6-364d-4300-9906-c9b71461ef5b]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Image download 0.00 MB at 0.00 MB/s Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82c0b46-87d3-4226-b78d-7e368d45b52c]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:57 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD Nov 05 17:53:57 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 1073741824" returned: 0 in 0.514s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:57 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD Nov 05 17:53:57 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:57 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 Nov 05 17:53:57 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:57 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:57 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD Nov 05 17:53:57 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11907580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7dc4e5-c287-4a34-8623-46b6ae1186c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:54Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Creating volume 8c7dc4e5-c287-4a34-8623-46b6ae1186c1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:57 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD Nov 05 17:53:57 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71722f50-37a0-4cd9-906e-cb3d3d75583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a69223b-1729-4aa4-ba57-a36b335a50a3', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:57 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 1073741824 Nov 05 17:53:57 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838f2496-ba6f-4edd-a4f9-9f02897dbd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Volume volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 (8a69223b-1729-4aa4-ba57-a36b335a50a3): created successfully Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838f2496-ba6f-4edd-a4f9-9f02897dbd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Flow 'volume_create_manager' (3392a7e9-69a6-4ac9-8d1a-b378173553fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-530d5a5d-f45d-42e6-a81a-61cfdd04b05b tempest-CreateVolumesFromImageTest-1198822146 None] Created volume successfully. Nov 05 17:53:58 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:58 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Temporary image 6388b874-f100-48a8-b9ff-171ca14ca799 is fetched for user f37f997741004453969d9b2186bdfadb. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db50390-b8d3-4d8c-a686-c84c093eee02]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:58 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD Nov 05 17:53:58 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:58 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 1073741824" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:58 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 Nov 05 17:53:58 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:58 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-8a69223b-1729-4aa4-ba57-a36b335a50a3-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-8a69223b-1729-4aa4-ba57-a36b335a50a3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-quobyte-8a69223b-1729-4aa4-ba57-a36b335a50a3" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-8a69223b-1729-4aa4-ba57-a36b335a50a3" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa9112-8486-406f-a674-8710d6952700]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:58 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD Nov 05 17:53:58 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:58 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:58 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 Nov 05 17:53:58 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.127s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126297571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c57ee21-76c5-46a7-8277-f2cfa4c9b803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:55Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Creating volume 8c57ee21-76c5-46a7-8277-f2cfa4c9b803 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:58 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5d99aa-cf98-4604-8dd0-727f35fa5eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a62c5d-1af9-44b5-833f-68ff64fff7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:58 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 1073741824 Nov 05 17:53:58 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 (8c7dc4e5-c287-4a34-8623-46b6ae1186c1): created successfully Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a62c5d-1af9-44b5-833f-68ff64fff7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (2d823d5c-ba7f-476c-85a9-d3ba2ec0cabf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f5431f18-d757-4ad2-b57c-f5c0a7f98540 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created volume successfully. Nov 05 17:53:58 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:53:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:59 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3" returned: 0 in 0.412s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:59 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3 Nov 05 17:53:59 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:59 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 1073741824" returned: 0 in 0.467s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:59 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 Nov 05 17:53:59 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:59 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8a69223b-1729-4aa4-ba57-a36b335a50a3" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-8a69223b-1729-4aa4-ba57-a36b335a50a3" released by "delete_volume" :: held 0.732s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Created reservations ['25c03fd5-7924-404d-9b15-e4fcd207776e', '2328e4cc-5319-427c-955b-a6deee4dfede', 'e2a8c022-5410-4ccd-b138-9b8346ba5c98', '72b5ce3b-69d1-48c0-be70-ba3b69c26fa7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:59 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:53:59 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:59 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.839s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1028567108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ae79d-35b1-4b81-8d5b-a83550a97549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:55Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Creating volume 2a8ae79d-35b1-4b81-8d5b-a83550a97549 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:53:59 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2d585b-1290-41ce-a04a-2da15efbf53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82b3f7f-d3bd-47f1-a34e-169e7371ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:53:59 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 1073741824 Nov 05 17:53:59 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:53:59 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 (8c57ee21-76c5-46a7-8277-f2cfa4c9b803): created successfully Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82b3f7f-d3bd-47f1-a34e-169e7371ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (4fe3ff40-f910-421e-ae67-f01a732251e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:53:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0c3103bb-e902-49f4-82ea-0c4a7527c6bb tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created volume successfully. Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-7c33dde2-429a-4a81-8b13-00297015f941-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:59 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-7c33dde2-429a-4a81-8b13-00297015f941-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Deleted volume successfully. Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c6918302-a2e9-4206-8bc3-5d9eba624c24 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-8a69223b-1729-4aa4-ba57-a36b335a50a3-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-quobyte-7c33dde2-429a-4a81-8b13-00297015f941" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-7c33dde2-429a-4a81-8b13-00297015f941" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3794da-ba97-41ef-b095-10e92ad3461e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:53:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:00 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 Nov 05 17:54:00 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:00 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 1073741824" returned: 0 in 0.504s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:00 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 Nov 05 17:54:00 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:00 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:00 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941 Nov 05 17:54:00 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:00 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.327s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1504697203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7374038-f9d1-4d69-a05f-67ed7d28fe18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:56Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Creating volume f7374038-f9d1-4d69-a05f-67ed7d28fe18 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:00 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237479d4-bc84-4c69-a9db-c4a6e1cf8c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f07aeae-34e9-4741-86a2-5e74f4b47bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:00 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 1073741824 Nov 05 17:54:00 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:00 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 (2a8ae79d-35b1-4b81-8d5b-a83550a97549): created successfully Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f07aeae-34e9-4741-86a2-5e74f4b47bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (45adbf3f-9d20-420b-a819-1d893f86b4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-57ac715b-bc57-4cdc-9a4e-80009ccded59 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created volume successfully. Nov 05 17:54:00 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7c33dde2-429a-4a81-8b13-00297015f941" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-7c33dde2-429a-4a81-8b13-00297015f941" released by "delete_volume" :: held 0.715s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Created reservations ['35c2e159-f065-4f5b-9a2e-0f70ee0b42ff', '5ea4c16e-3195-41cc-a579-314bd0ae615f', '7973cedb-52da-415f-987d-5b6dcbe92289', '7d238742-d586-487b-8055-2d9a56ffdac8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:00 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:00 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:00 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 1073741824" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:00 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 Nov 05 17:54:00 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-a4c6ec96-2c14-479a-a0ba-0e773af0ec02-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-a4c6ec96-2c14-479a-a0ba-0e773af0ec02-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-quobyte-a4c6ec96-2c14-479a-a0ba-0e773af0ec02" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-a4c6ec96-2c14-479a-a0ba-0e773af0ec02" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:01 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Deleted volume successfully. Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc700e06-96ec-4235-b4bd-ed28a994d3aa]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-40b25571-5e24-4985-b542-55480640774f tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-7c33dde2-429a-4a81-8b13-00297015f941-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:01 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 Nov 05 17:54:01 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:01 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.761s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839932850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21daae47-577c-438d-b41c-220381373aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1e973372464b5eacad056bd7992af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:56Z,use_quota=True,user_id='52e4d9a9b84545cbb896fdf0a2f8ba01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Creating volume 21daae47-577c-438d-b41c-220381373aa2 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:01 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827afbe0-dd6c-4dad-9eb1-9a8bbf7e86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:01 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 1073741824 Nov 05 17:54:01 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87a5d3d-e4d7-4ff5-a662-963f604717f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 (f7374038-f9d1-4d69-a05f-67ed7d28fe18): created successfully Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87a5d3d-e4d7-4ff5-a662-963f604717f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (3d2f4531-c373-4935-9644-bac0012bb7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-69905256-8bbb-4a53-98b0-4389f744c10f tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created volume successfully. Nov 05 17:54:01 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:01 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02 Nov 05 17:54:01 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:01 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 1073741824" returned: 0 in 0.441s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:01 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a4c6ec96-2c14-479a-a0ba-0e773af0ec02" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-a4c6ec96-2c14-479a-a0ba-0e773af0ec02" released by "delete_volume" :: held 0.709s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:01 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 Nov 05 17:54:01 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Created reservations ['caa1f26d-eded-44e6-ae65-59292358f0d6', '7ed017d8-1aad-4710-b21e-7178b496ef17', 'ab1fac9c-f4c6-47c2-837c-2daad7404218', '870bb32f-f6fb-45cb-8fa0-8c4b2e47a106'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:01 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:01 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:01 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.899s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9880071-b90f-432f-8afe-beadf67c9b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f26a0c96b094e328568960aae20e4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:55Z,use_quota=True,user_id='b943cde146294cc1982aa6d95d2fb4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Creating volume e9880071-b90f-432f-8afe-beadf67c9b87 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:01 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3866e8f5-0613-4fdd-97d1-e92c6ea7a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21daae47-577c-438d-b41c-220381373aa2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25cba86-969c-43c6-86c2-4cc98915c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:02 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 1073741824 Nov 05 17:54:02 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Volume volume-21daae47-577c-438d-b41c-220381373aa2 (21daae47-577c-438d-b41c-220381373aa2): created successfully Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25cba86-969c-43c6-86c2-4cc98915c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Flow 'volume_create_manager' (cb6963bf-f12e-427f-83e4-e9160e219014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0079b722-1855-4a7d-b876-7db047bd60dc tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created volume successfully. Nov 05 17:54:02 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.304s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-d250e576-354f-4255-a543-ed333c522f64-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Deleted volume successfully. Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-d250e576-354f-4255-a543-ed333c522f64-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-148c0e91-cba7-42ef-b573-75ef3d906a1b tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-a4c6ec96-2c14-479a-a0ba-0e773af0ec02-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-quobyte-d250e576-354f-4255-a543-ed333c522f64" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-d250e576-354f-4255-a543-ed333c522f64" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6842b21-39ce-4265-a9f2-d20ed84cc4bf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:02 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 Nov 05 17:54:02 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:02 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 1073741824" returned: 0 in 0.504s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:02 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 Nov 05 17:54:02 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:02 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:02 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64 Nov 05 17:54:02 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:02 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.870s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dde96a-ea81-4318-8c7c-92b10a4650fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f84d34f63754de5bc1572faa3b48ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:53:57Z,use_quota=True,user_id='f37f997741004453969d9b2186bdfadb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(162ad151-1b60-41d7-83d0-80a924c88acf),volume_type_id=162ad151-1b60-41d7-83d0-80a924c88acf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Creating volume 21dde96a-ea81-4318-8c7c-92b10a4650fe {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:02 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe 1073741824 Nov 05 17:54:02 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Attempting download of 801481be-0420-4e94-852c-68765b886406 ((None, [{'url': 'file:///opt/stack/data/glance/images/801481be-0420-4e94-852c-68765b886406', 'metadata': {}}])) to volume e9880071-b90f-432f-8afe-beadf67c9b87. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434dfc2-9365-4316-9fb4-15728e420db2]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801481be-0420-4e94-852c-68765b886406_cr8bqlkz {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:02 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d250e576-354f-4255-a543-ed333c522f64" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-21daae47-577c-438d-b41c-220381373aa2-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-d250e576-354f-4255-a543-ed333c522f64" released by "delete_volume" :: held 0.736s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-21daae47-577c-438d-b41c-220381373aa2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:03 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801481be-0420-4e94-852c-68765b886406_cr8bqlkz Nov 05 17:54:03 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-quobyte-21daae47-577c-438d-b41c-220381373aa2" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-21daae47-577c-438d-b41c-220381373aa2" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Created reservations ['42d50b4a-3e7c-4c3e-bd2e-ef495182b613', 'defe5886-1b5c-4d66-8995-d817b6d6477b', '95b53c0a-704c-4fe0-858e-d90a3093e5d6', '4e521078-b3a2-48ac-9da7-fe15af73b5d6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8559c2-042e-4043-b113-c98f7fadc0f5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 Nov 05 17:54:03 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:03 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_801481be-0420-4e94-852c-68765b886406_cr8bqlkz" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801481be-0420-4e94-852c-68765b886406_cr8bqlkz {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe 1073741824" returned: 0 in 0.609s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-bf6e3762-a386-41bf-b97f-54b7ffb017fc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-bf6e3762-a386-41bf-b97f-54b7ffb017fc-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:03 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801481be-0420-4e94-852c-68765b886406_cr8bqlkz Nov 05 17:54:03 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe Nov 05 17:54:03 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "cinder-quobyte-bf6e3762-a386-41bf-b97f-54b7ffb017fc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-bf6e3762-a386-41bf-b97f-54b7ffb017fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9d68d5-2ef4-430b-bb7b-e538a21addbf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2" returned: 0 in 0.503s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.438s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:03 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2 Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:03 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Deleted volume successfully. Nov 05 17:54:03 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc Nov 05 17:54:03 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9938a932-2afa-443d-a3e2-eb4332eb21e3 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-d250e576-354f-4255-a543-ed333c522f64-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:03 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801481be-0420-4e94-852c-68765b886406_cr8bqlkz" returned: 1 in 0.487s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_801481be-0420-4e94-852c-68765b886406_cr8bqlkz' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b599d712-d79f-46d4-9e73-214ac5514dec]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Attempting download of 6388b874-f100-48a8-b9ff-171ca14ca799 ((None, [{'url': 'file:///opt/stack/data/glance/images/6388b874-f100-48a8-b9ff-171ca14ca799', 'metadata': {}}])) to volume 21dde96a-ea81-4318-8c7c-92b10a4650fe. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e7aee3-c729-46c0-a50b-111660532467]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6388b874-f100-48a8-b9ff-171ca14ca799_rdbzhca4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:03 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD Nov 05 17:54:03 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:03 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21daae47-577c-438d-b41c-220381373aa2" returned: 0 in 0.325s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-21daae47-577c-438d-b41c-220381373aa2" released by "delete_volume" :: held 0.883s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:04 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created reservations ['1795b31c-f7e9-4d07-91ac-24a8a9deef47', '590b8d4e-64c3-4c67-9b03-be904c2887ac', 'fe888fd1-c863-4363-a3d4-6f09931f0b32', 'b021d698-a85d-49f2-bde8-13f7434b1b6e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc" returned: 0 in 0.438s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:04 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6388b874-f100-48a8-b9ff-171ca14ca799_rdbzhca4 Nov 05 17:54:04 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc Nov 05 17:54:04 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:04 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:04 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:04 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD Nov 05 17:54:04 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6388b874-f100-48a8-b9ff-171ca14ca799_rdbzhca4" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6388b874-f100-48a8-b9ff-171ca14ca799_rdbzhca4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:04 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-bf6e3762-a386-41bf-b97f-54b7ffb017fc" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-quobyte-bf6e3762-a386-41bf-b97f-54b7ffb017fc" released by "delete_volume" :: held 0.816s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Created reservations ['6ebc0d2a-9f1e-480a-9152-b7670e6e7f3a', '3732b4f2-2f7e-4b42-aa32-bca3b3de855d', 'ac7bd54e-ba67-45a8-8efe-839ac6bc1afd', '7dcd5142-82bf-4e75-b468-c1bfcbb34bbe'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:04 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6388b874-f100-48a8-b9ff-171ca14ca799_rdbzhca4 Nov 05 17:54:04 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Deleted volume successfully. Nov 05 17:54:04 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8cc11b24-f30c-4990-870c-13befe31a44c tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-21daae47-577c-438d-b41c-220381373aa2-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] 801481be-0420-4e94-852c-68765b886406 was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:04 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 Nov 05 17:54:04 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:04 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:04 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6388b874-f100-48a8-b9ff-171ca14ca799_rdbzhca4" returned: 1 in 0.407s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6388b874-f100-48a8-b9ff-171ca14ca799_rdbzhca4' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b43926-fe54-4656-b038-d308f79865f7]: (4, 'raw') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:04 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD Nov 05 17:54:04 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:04 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Deleted volume successfully. Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca32852d-18bd-4193-a085-f7cd941fef08 tempest-CreateVolumesFromImageTest-1198822146 None] Lock "cinder-bf6e3762-a386-41bf-b97f-54b7ffb017fc-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:05 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:05 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87" returned: 0 in 0.580s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_801481be-0420-4e94-852c-68765b886406_6x0g__9ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:54:05 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:05 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 1G Nov 05 17:54:05 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-f7374038-f9d1-4d69-a05f-67ed7d28fe18-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-f7374038-f9d1-4d69-a05f-67ed7d28fe18-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:05 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD Nov 05 17:54:05 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-quobyte-f7374038-f9d1-4d69-a05f-67ed7d28fe18" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-f7374038-f9d1-4d69-a05f-67ed7d28fe18" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c7a404-377e-4e18-9c54-43b3d5ac1e67]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:05 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 Nov 05 17:54:05 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:05 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] 6388b874-f100-48a8-b9ff-171ca14ca799 was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:05 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe Nov 05 17:54:05 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:05 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 1G" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Downloaded image 801481be-0420-4e94-852c-68765b886406 ((None, [{'url': 'file:///opt/stack/data/glance/images/801481be-0420-4e94-852c-68765b886406', 'metadata': {}}])) to volume e9880071-b90f-432f-8afe-beadf67c9b87 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Temporary image 801481be-0420-4e94-852c-68765b886406 for user b943cde146294cc1982aa6d95d2fb4d8 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Marking volume e9880071-b90f-432f-8afe-beadf67c9b87 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Copying metadata from image 801481be-0420-4e94-852c-68765b886406 to e9880071-b90f-432f-8afe-beadf67c9b87. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Creating volume glance metadata for volume e9880071-b90f-432f-8afe-beadf67c9b87 backed by image 801481be-0420-4e94-852c-68765b886406 with: {'image_id': '801481be-0420-4e94-852c-68765b886406', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c52dfc8832887500915278aa950da839', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1ea8fc-86e6-46ac-8b3a-2102c7f33be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9880071-b90f-432f-8afe-beadf67c9b87', 'volume_size': 1, 'image_id': '801481be-0420-4e94-852c-68765b886406', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/801481be-0420-4e94-852c-68765b886406', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c52dfc8832887500915278aa950da839', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f26a0c96b094e328568960aae20e4db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '432a38d925139a7a8dd95f5d31f781b81bc70c46dd114543562b4da0418d74e242dde40e8e3c06a517aa338f1e7456c69489c082798cc7121b7f12419dd88d23', 'id': '801481be-0420-4e94-852c-68765b886406', 'created_at': datetime.datetime(2026, 11, 5, 16, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/801481be-0420-4e94-852c-68765b886406/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c938414-ac50-418f-a623-d76c73e1e2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Volume volume-e9880071-b90f-432f-8afe-beadf67c9b87 (e9880071-b90f-432f-8afe-beadf67c9b87): created successfully Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c938414-ac50-418f-a623-d76c73e1e2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Flow 'volume_create_manager' (5f91716f-0787-417f-a8cd-43f9c73a79ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-67d5b851-d3db-4980-a400-339a48580132 tempest-VolumeImageDependencyTests-733086927 None] Created volume successfully. Nov 05 17:54:05 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18" returned: 0 in 0.511s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:05 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18 Nov 05 17:54:05 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:06 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe" returned: 0 in 0.596s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6388b874-f100-48a8-b9ff-171ca14ca799_bqhomfucdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:54:06 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:06 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe 1G Nov 05 17:54:06 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:06 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f7374038-f9d1-4d69-a05f-67ed7d28fe18" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-f7374038-f9d1-4d69-a05f-67ed7d28fe18" released by "delete_volume" :: held 0.865s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created reservations ['e8e0eab6-10b9-4238-919d-40564571cc2e', 'ef4dd058-7ab4-466c-af21-922cdf89711c', '0a2da4da-6efd-4c76-a885-9fab42ba02a1', 'c684625a-c41a-463a-b6b0-2204e45fb501'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:06 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:06 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-8c57ee21-76c5-46a7-8277-f2cfa4c9b803-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-8c57ee21-76c5-46a7-8277-f2cfa4c9b803-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-quobyte-8c57ee21-76c5-46a7-8277-f2cfa4c9b803" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-8c57ee21-76c5-46a7-8277-f2cfa4c9b803" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:06 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe 1G" returned: 0 in 0.456s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Downloaded image 6388b874-f100-48a8-b9ff-171ca14ca799 ((None, [{'url': 'file:///opt/stack/data/glance/images/6388b874-f100-48a8-b9ff-171ca14ca799', 'metadata': {}}])) to volume 21dde96a-ea81-4318-8c7c-92b10a4650fe successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Temporary image 6388b874-f100-48a8-b9ff-171ca14ca799 for user f37f997741004453969d9b2186bdfadb is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Marking volume 21dde96a-ea81-4318-8c7c-92b10a4650fe as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ab4f1-8549-459a-aed7-05e00bf93968]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Copying metadata from image 6388b874-f100-48a8-b9ff-171ca14ca799 to 21dde96a-ea81-4318-8c7c-92b10a4650fe. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Creating volume glance metadata for volume 21dde96a-ea81-4318-8c7c-92b10a4650fe backed by image 6388b874-f100-48a8-b9ff-171ca14ca799 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6388b874-f100-48a8-b9ff-171ca14ca799', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '071e75ee15651b3e50b04deff6a3b7d5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d42c6a-1ffc-405b-a32f-6872211b3d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21dde96a-ea81-4318-8c7c-92b10a4650fe', 'volume_size': 1, 'image_id': '6388b874-f100-48a8-b9ff-171ca14ca799', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6388b874-f100-48a8-b9ff-171ca14ca799', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '071e75ee15651b3e50b04deff6a3b7d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f84d34f63754de5bc1572faa3b48ef3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69a545c30e4adfcfba8f7da142d509fdf36be6bb966cf74f527ea797103ea11b6886fb53d7a80bb8cdeb2d2b79e1175b664843c2367be6007edcb30b5f09535f', 'id': '6388b874-f100-48a8-b9ff-171ca14ca799', 'created_at': datetime.datetime(2026, 11, 5, 16, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 16, 53, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6388b874-f100-48a8-b9ff-171ca14ca799/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:06 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a410a925-3cfa-43c9-8834-7f4265773e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Volume volume-21dde96a-ea81-4318-8c7c-92b10a4650fe (21dde96a-ea81-4318-8c7c-92b10a4650fe): created successfully Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a410a925-3cfa-43c9-8834-7f4265773e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:06 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 Nov 05 17:54:06 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Flow 'volume_create_manager' (96643538-57bb-4811-b5c9-23c19612703c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Deleted volume successfully. Nov 05 17:54:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-72009f3a-0123-47dc-8823-14391ba57b68 tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Created volume successfully. Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e4bdc588-b0ce-4e0d-959f-9d441de72525 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-f7374038-f9d1-4d69-a05f-67ed7d28fe18-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Acquiring lock "cinder-e9880071-b90f-432f-8afe-beadf67c9b87-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Lock "cinder-e9880071-b90f-432f-8afe-beadf67c9b87-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Acquiring lock "cinder-quobyte-e9880071-b90f-432f-8afe-beadf67c9b87" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Lock "cinder-quobyte-e9880071-b90f-432f-8afe-beadf67c9b87" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf151ae-7897-444c-aeae-79cb6e1fdd21]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:07 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803" returned: 0 in 0.473s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:07 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 Nov 05 17:54:07 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:07 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803 Nov 05 17:54:07 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:07 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c57ee21-76c5-46a7-8277-f2cfa4c9b803" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-8c57ee21-76c5-46a7-8277-f2cfa4c9b803" released by "delete_volume" :: held 0.814s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:07 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87" returned: 0 in 0.396s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:07 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87 Nov 05 17:54:07 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created reservations ['87115cca-dd87-464a-815b-5d75b70f2851', '95fe6fcf-e5b7-459d-9fb7-ba6b4999f0d9', '17e6a0ba-face-4a7c-8e12-d23b74afb178', '8c5ef4eb-33a2-45b5-b830-41522890cb0f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Acquiring lock "cinder-21dde96a-ea81-4318-8c7c-92b10a4650fe-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:07 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "cinder-21dde96a-ea81-4318-8c7c-92b10a4650fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:07 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Acquiring lock "cinder-quobyte-21dde96a-ea81-4318-8c7c-92b10a4650fe" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:07 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e9880071-b90f-432f-8afe-beadf67c9b87" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-2a8ae79d-35b1-4b81-8d5b-a83550a97549-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "cinder-quobyte-21dde96a-ea81-4318-8c7c-92b10a4650fe" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Lock "cinder-quobyte-e9880071-b90f-432f-8afe-beadf67c9b87" released by "delete_volume" :: held 0.785s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-2a8ae79d-35b1-4b81-8d5b-a83550a97549-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ded2295-d0f0-499a-828e-2553b4445d0f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-quobyte-2a8ae79d-35b1-4b81-8d5b-a83550a97549" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Created reservations ['bc95b565-b66d-420d-910f-cfcd920ab824', 'c6b1e527-9a28-4706-a35e-4465ff90802f', '4de9092c-7f6b-441b-ba35-e8910f6edb8d', '762afcd2-a595-428b-bb7f-c3588e99c5f9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-2a8ae79d-35b1-4b81-8d5b-a83550a97549" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[31578913-3621-448b-9d8f-352600a0784f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:07 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe Nov 05 17:54:07 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:08 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.418s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Deleted volume successfully. Nov 05 17:54:08 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:08 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ea1532a-707b-4eed-9cde-67ae339fe192 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-8c57ee21-76c5-46a7-8277-f2cfa4c9b803-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:08 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 Nov 05 17:54:08 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:08 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe" returned: 0 in 0.548s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:08 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe Nov 05 17:54:08 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:08 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Deleted volume successfully. Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e2b162ad-99c3-48a7-b0ed-62373f4e3564 tempest-VolumeImageDependencyTests-733086927 None] Lock "cinder-e9880071-b90f-432f-8afe-beadf67c9b87-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:08 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549" returned: 0 in 0.591s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:08 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549 Nov 05 17:54:08 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:08 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (07070ed3-cde3-412b-bf06-11418b3750a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dc4da9-cc4f-4f4c-b75d-3696a61410e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-21dde96a-ea81-4318-8c7c-92b10a4650fe" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "cinder-quobyte-21dde96a-ea81-4318-8c7c-92b10a4650fe" released by "delete_volume" :: held 1.016s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dc4da9-cc4f-4f4c-b75d-3696a61410e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-60709834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3b8e84-9a4c-4348-83c3-6cfca76aac44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:09Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60debfc-5970-4888-9de3-73cb34f37dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60debfc-5970-4888-9de3-73cb34f37dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784a8e66-09a0-408b-8f52-5abb22cabf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784a8e66-09a0-408b-8f52-5abb22cabf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3b8e84-9a4c-4348-83c3-6cfca76aac44', 'volume_name': 'volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976d0663-897e-4fdf-996e-421b32715ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976d0663-897e-4fdf-996e-421b32715ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dd634f-d092-4105-a35f-bdbabf8a9196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume 5e3b8e84-9a4c-4348-83c3-6cfca76aac44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44', 'volume_size': 1} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-60709834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3b8e84-9a4c-4348-83c3-6cfca76aac44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:09Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Creating volume 5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:08 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:08 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 1073741824 Nov 05 17:54:08 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:08 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2a8ae79d-35b1-4b81-8d5b-a83550a97549" returned: 0 in 0.343s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-2a8ae79d-35b1-4b81-8d5b-a83550a97549" released by "delete_volume" :: held 1.004s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Created reservations ['99c2af7f-f660-4ba4-bfe3-9a4145e8ed04', 'b36ccc97-4eb6-496c-ae05-baced5100f33', '1bccfb93-7b2e-4c64-8999-a7176d56c66f', '7a3874dc-c9ea-4451-b821-a76d3d4842c9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created reservations ['d4f83c4c-7843-4c59-aaf6-1cd49c3b994a', 'f309a8a2-a9ed-4d71-a624-554e556fde3d', 'db45d1c7-dac3-498d-853e-e26a9a69cf17', '5b977259-9a5f-4153-8c50-8ba8cb51d60e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:09 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:09 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:09 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:09 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:09 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:09 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 1073741824" returned: 0 in 0.519s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Deleted volume successfully. Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a717c2d6-d987-48b6-9665-a452bee14a0a tempest-VolumeAndVolumeTypeFromImageTest-1772691479 None] Lock "cinder-21dde96a-ea81-4318-8c7c-92b10a4650fe-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:09 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.301s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Deleted volume successfully. Nov 05 17:54:09 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 Nov 05 17:54:09 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d90b1d6-41d0-4e81-a51c-c74b9a1cef90 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-2a8ae79d-35b1-4b81-8d5b-a83550a97549-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:09 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dd634f-d092-4105-a35f-bdbabf8a9196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0a124c-83d2-4609-ac7e-2a18618d214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 (5e3b8e84-9a4c-4348-83c3-6cfca76aac44): created successfully Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0a124c-83d2-4609-ac7e-2a18618d214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (07070ed3-cde3-412b-bf06-11418b3750a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5134187b-0a25-4f43-8a63-7dd6e0e71eea tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created volume successfully. Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-8c7dc4e5-c287-4a34-8623-46b6ae1186c1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-8c7dc4e5-c287-4a34-8623-46b6ae1186c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-quobyte-8c7dc4e5-c287-4a34-8623-46b6ae1186c1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-8c7dc4e5-c287-4a34-8623-46b6ae1186c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c59be0-ca42-4e73-b20b-a8bd28baaaa3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:10 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 Nov 05 17:54:10 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:10 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:10 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1 Nov 05 17:54:10 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:10 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-8c7dc4e5-c287-4a34-8623-46b6ae1186c1" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-8c7dc4e5-c287-4a34-8623-46b6ae1186c1" released by "delete_volume" :: held 0.818s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created reservations ['6081c8f4-b333-4b0c-8c93-7c980cec70e0', 'd6815aeb-3cc2-4e78-bcaa-063226f95279', '55df6132-0548-4222-9a02-cdba415dfb7f', '6b99b102-64fc-4f91-82ed-273828dfac6c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:11 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:11 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Creating offline snapshot 43c2a28e-a3cc-4647-b00a-e191acc1bad6 of volume 5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-0fd311f1-f88f-478b-8e12-a8023cde90f8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb9deb5-cb7a-477a-b448-7680f20b8ea8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-0fd311f1-f88f-478b-8e12-a8023cde90f8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "cinder-quobyte-0fd311f1-f88f-478b-8e12-a8023cde90f8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-0fd311f1-f88f-478b-8e12-a8023cde90f8" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:11 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 Nov 05 17:54:11 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ad51e-0182-450d-bcf1-fac04a950c43]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:11 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.504s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Deleted volume successfully. Nov 05 17:54:11 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 Nov 05 17:54:11 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-14a3245c-458b-4bd3-9e78-37884a4bc638 tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-8c7dc4e5-c287-4a34-8623-46b6ae1186c1-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:11 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" returned: 0 in 0.587s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:11 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 1G Nov 05 17:54:11 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:12 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8" returned: 0 in 0.547s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:12 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8 Nov 05 17:54:12 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:12 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-0fd311f1-f88f-478b-8e12-a8023cde90f8" returned: 0 in 0.387s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-quobyte-0fd311f1-f88f-478b-8e12-a8023cde90f8" released by "delete_volume" :: held 1.011s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Created reservations ['20c43fab-cf19-416d-a332-bd9ba4eca520', 'f4c87225-ae50-45d6-8d15-5f55c692f564', '9763a492-14b2-4b64-8725-ff01fba5c99d', '53f3fb1e-c0bb-4bff-bbd6-5dd437790a39'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:12 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 1G" returned: 0 in 0.646s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:12 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 Nov 05 17:54:12 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:12 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:12 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:12 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:12 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 is being set with open permissions: ugo+rw Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:12 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:12 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Deleted volume successfully. Nov 05 17:54:12 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 Nov 05 17:54:12 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23bb62f7-9570-4bf4-912a-9e2d79d9b50b tempest-CreateVolumesFromSourceVolumeTest-2134095502 None] Lock "cinder-0fd311f1-f88f-478b-8e12-a8023cde90f8-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:13 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:13 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.info Nov 05 17:54:13 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:13 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.info" returned: 0 in 0.290s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:13 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.info is being set with open permissions: ugo+rw Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:13 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.info Nov 05 17:54:13 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:13 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:13 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:13 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.info" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.677s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8a72b78d-776d-4138-ba60-082c2f101406 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Create snapshot completed successfully Nov 05 17:54:14 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:54:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:54:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (8ba07538-a545-4b27-840c-5c0c77bc858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1407e0d9-d0c8-4c2c-b9f5-7b76e1665b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1407e0d9-d0c8-4c2c-b9f5-7b76e1665b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465515911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11699cd-642a-4b9b-9063-9e1e849ef051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:15Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894c5f5b-443a-47cc-8780-3755c8c4c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894c5f5b-443a-47cc-8780-3755c8c4c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b630098-280b-47df-a1df-9c1ccf23214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b630098-280b-47df-a1df-9c1ccf23214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11699cd-642a-4b9b-9063-9e1e849ef051', 'volume_name': 'volume-f11699cd-642a-4b9b-9063-9e1e849ef051', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4868dd5e-a54a-491b-b323-748ea8ff295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4868dd5e-a54a-491b-b323-748ea8ff295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f7bb37-00c9-4866-8151-37e32b8e6771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume f11699cd-642a-4b9b-9063-9e1e849ef051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11699cd-642a-4b9b-9063-9e1e849ef051', 'volume_size': 1} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465515911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11699cd-642a-4b9b-9063-9e1e849ef051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:15Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Creating volume f11699cd-642a-4b9b-9063-9e1e849ef051 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:15 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:15 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 1073741824 Nov 05 17:54:15 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (483acbef-a44a-4230-82f9-0e39e63212ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac263ac8-fd21-4c96-bd4a-078faf93d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac263ac8-fd21-4c96-bd4a-078faf93d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983960054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3ec361-dbeb-4cdb-a9d4-df28220409c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:16Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47c6437-29ce-4947-aacc-b0a0d109c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47c6437-29ce-4947-aacc-b0a0d109c228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7bd88d-07b6-4f9d-ab92-9885f187c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7bd88d-07b6-4f9d-ab92-9885f187c54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3ec361-dbeb-4cdb-a9d4-df28220409c0', 'volume_name': 'volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefc2fa1-2711-4536-be5e-dfd8dd21ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefc2fa1-2711-4536-be5e-dfd8dd21ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dfb0db-a21b-4ac0-b123-1314b8f070b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume 9d3ec361-dbeb-4cdb-a9d4-df28220409c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0', 'volume_size': 1} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:15 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 1073741824" returned: 0 in 0.704s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:15 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 Nov 05 17:54:15 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:16 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983960054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3ec361-dbeb-4cdb-a9d4-df28220409c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:16Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Creating volume 9d3ec361-dbeb-4cdb-a9d4-df28220409c0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:16 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 1073741824 Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f7bb37-00c9-4866-8151-37e32b8e6771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11699cd-642a-4b9b-9063-9e1e849ef051', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:16 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392cd5ea-0f84-4a3b-b372-812294bf8a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (760dac15-e63a-42dc-b554-d15f64386d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b389ffc4-1b5b-463c-a722-080a0cd654fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume volume-f11699cd-642a-4b9b-9063-9e1e849ef051 (f11699cd-642a-4b9b-9063-9e1e849ef051): created successfully Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392cd5ea-0f84-4a3b-b372-812294bf8a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (8ba07538-a545-4b27-840c-5c0c77bc858a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b389ffc4-1b5b-463c-a722-080a0cd654fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808824045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed04cb21-0a09-4624-adbf-705f193f5342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:16Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcca5091-e34c-476b-8d32-9870f158e928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcca5091-e34c-476b-8d32-9870f158e928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb87cef-0d04-462f-ba9d-38a839cba6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb87cef-0d04-462f-ba9d-38a839cba6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed04cb21-0a09-4624-adbf-705f193f5342', 'volume_name': 'volume-ed04cb21-0a09-4624-adbf-705f193f5342', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0a8116-7019-4c82-9931-c4b683970bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0a8116-7019-4c82-9931-c4b683970bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cedcc6-c11b-4a30-ba4d-748637d98d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume ed04cb21-0a09-4624-adbf-705f193f5342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed04cb21-0a09-4624-adbf-705f193f5342', 'volume_size': 1} Nov 05 17:54:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2d422824-2737-49d2-ba68-208308207701 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created volume successfully. Nov 05 17:54:17 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 1073741824" returned: 0 in 0.830s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (e75ed602-0294-44a6-9080-82007d29b7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b762a6-7c0c-4159-9fae-2b655ee37494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b762a6-7c0c-4159-9fae-2b655ee37494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910347282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46317e2-f649-4eb2-8bb7-732a851ee5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:17Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8d0788-dd5c-4b78-b76a-9fbd5bd589ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8d0788-dd5c-4b78-b76a-9fbd5bd589ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09220307-9d75-4751-a873-d80eb4229320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09220307-9d75-4751-a873-d80eb4229320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46317e2-f649-4eb2-8bb7-732a851ee5c8', 'volume_name': 'volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85a1479-e6e0-4b7d-8e4c-3a97f9db0580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85a1479-e6e0-4b7d-8e4c-3a97f9db0580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caebf485-92cb-4790-81f8-fa7b28e18a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume c46317e2-f649-4eb2-8bb7-732a851ee5c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8', 'volume_size': 1} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:17 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 Nov 05 17:54:17 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:17 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808824045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed04cb21-0a09-4624-adbf-705f193f5342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:16Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Creating volume ed04cb21-0a09-4624-adbf-705f193f5342 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:17 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 1073741824 Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dfb0db-a21b-4ac0-b123-1314b8f070b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:17 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4e5ca5-2597-4ce8-8d34-3b66648c3d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 (9d3ec361-dbeb-4cdb-a9d4-df28220409c0): created successfully Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4e5ca5-2597-4ce8-8d34-3b66648c3d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (483acbef-a44a-4230-82f9-0e39e63212ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7a67d802-8358-430a-aa2d-a3b555d2e2e3 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created volume successfully. Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (8b18d3b8-4619-41c2-96e9-ab5cda257d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a1ed7a-86a5-47f9-bbcc-72ebd97d3fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a1ed7a-86a5-47f9-bbcc-72ebd97d3fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955667267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ea2303-0225-4601-be01-1205a1eda87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:18Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed317b2-bd00-4fb2-9186-381bf06aafc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed317b2-bd00-4fb2-9186-381bf06aafc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7284b0d-e6ea-4bea-8fee-17d95e8ea2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7284b0d-e6ea-4bea-8fee-17d95e8ea2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ea2303-0225-4601-be01-1205a1eda87d', 'volume_name': 'volume-12ea2303-0225-4601-be01-1205a1eda87d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6db30a-5d21-470e-ab0a-d066569c160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6db30a-5d21-470e-ab0a-d066569c160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a376f0fe-794b-4bbd-b466-a27f97c6b0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume 12ea2303-0225-4601-be01-1205a1eda87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ea2303-0225-4601-be01-1205a1eda87d', 'volume_size': 1} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Flow 'volume_create_manager' (e0100976-b514-4bcb-94f1-3d7198801341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8494f8e0-21be-49aa-bb50-14b153aa27e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8494f8e0-21be-49aa-bb50-14b153aa27e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1239435963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b41640-8764-4c4e-ae2e-5bdb0809323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ab07dc9004fe28485e858629bff04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:18Z,use_quota=True,user_id='b29181c01a7f4d528ad2471097a2ed22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5f2b32-561d-42b4-95ac-23eb75eb6949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5f2b32-561d-42b4-95ac-23eb75eb6949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc625e46-e37f-4224-a448-dd5012f1dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc625e46-e37f-4224-a448-dd5012f1dace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b41640-8764-4c4e-ae2e-5bdb0809323a', 'volume_name': 'volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8851b8a-9955-42cb-beaa-b5f22609931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8851b8a-9955-42cb-beaa-b5f22609931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14d54ca-c21a-4ef7-b479-e26fb31555ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Volume c9b41640-8764-4c4e-ae2e-5bdb0809323a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a', 'volume_size': 1} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:18 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 1073741824" returned: 0 in 0.598s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:18 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 Nov 05 17:54:18 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:18 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910347282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46317e2-f649-4eb2-8bb7-732a851ee5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:17Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Creating volume c46317e2-f649-4eb2-8bb7-732a851ee5c8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:18 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cedcc6-c11b-4a30-ba4d-748637d98d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed04cb21-0a09-4624-adbf-705f193f5342', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223b8964-dd02-4c62-9006-d52639b9bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 1073741824 Nov 05 17:54:18 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume volume-ed04cb21-0a09-4624-adbf-705f193f5342 (ed04cb21-0a09-4624-adbf-705f193f5342): created successfully Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223b8964-dd02-4c62-9006-d52639b9bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (760dac15-e63a-42dc-b554-d15f64386d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2fc40428-b7e2-4304-98b6-73891550c35b tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created volume successfully. Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Flow 'volume_create_manager' (44252b11-3267-449b-bb4b-680583677125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85a70f0-0cb5-4772-9f20-26a5ca604a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85a70f0-0cb5-4772-9f20-26a5ca604a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392d4cd4-3981-43d1-9759-fdc49cf3203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6e87b622cc46dd9beafa90dbf755be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:19Z,use_quota=True,user_id='6be21d64f779470f99e607b583e811bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef0bf34-2bb8-453c-b415-8fbe83bb2def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef0bf34-2bb8-453c-b415-8fbe83bb2def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a076b8f-0ab2-459d-95de-026002805dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a076b8f-0ab2-459d-95de-026002805dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392d4cd4-3981-43d1-9759-fdc49cf3203c', 'volume_name': 'volume-392d4cd4-3981-43d1-9759-fdc49cf3203c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e10f9c-8f09-40ff-b3cc-777c7651bc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e10f9c-8f09-40ff-b3cc-777c7651bc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bc0f4e-2036-44be-b9f8-63c088299c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Volume 392d4cd4-3981-43d1-9759-fdc49cf3203c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392d4cd4-3981-43d1-9759-fdc49cf3203c', 'volume_size': 1} Nov 05 17:54:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:19 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 1073741824" returned: 0 in 0.527s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:19 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 Nov 05 17:54:19 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:19 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955667267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ea2303-0225-4601-be01-1205a1eda87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091c55575a944b14982d4c63cb47f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:18Z,use_quota=True,user_id='9781cba3fd994e9b89c24cdbd6b409d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Creating volume 12ea2303-0225-4601-be01-1205a1eda87d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caebf485-92cb-4790-81f8-fa7b28e18a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:19 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d 1073741824 Nov 05 17:54:19 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1f8cc4-3e09-48e6-8ddf-d8b28687d800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 (c46317e2-f649-4eb2-8bb7-732a851ee5c8): created successfully Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1f8cc4-3e09-48e6-8ddf-d8b28687d800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (e75ed602-0294-44a6-9080-82007d29b7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-10cece25-c643-4e43-9ce9-bc8ee8bf2a41 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created volume successfully. Nov 05 17:54:20 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d 1073741824" returned: 0 in 0.535s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:20 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d Nov 05 17:54:20 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (cb0fd398-bc53-4549-b098-10aeb1bc99fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ac028b-3be6-4969-abfb-17419067a7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:20 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.171s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1239435963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b41640-8764-4c4e-ae2e-5bdb0809323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ab07dc9004fe28485e858629bff04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:18Z,use_quota=True,user_id='b29181c01a7f4d528ad2471097a2ed22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Creating volume c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ac028b-3be6-4969-abfb-17419067a7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567422402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7632c894-b367-466d-b8d0-9305583aac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:20Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:20 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a 1073741824 Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6472a5-3369-46e7-9820-740418cf452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:20 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6472a5-3369-46e7-9820-740418cf452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b9807d-d79e-4df3-8507-78a2891751c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b9807d-d79e-4df3-8507-78a2891751c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7632c894-b367-466d-b8d0-9305583aac41', 'volume_name': 'volume-7632c894-b367-466d-b8d0-9305583aac41', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47092c3-3881-45ae-92bc-a5587e6d163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47092c3-3881-45ae-92bc-a5587e6d163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b3f2b2-bc3a-40aa-b185-6540657512ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Volume 7632c894-b367-466d-b8d0-9305583aac41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7632c894-b367-466d-b8d0-9305583aac41', 'volume_size': 1} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a376f0fe-794b-4bbd-b466-a27f97c6b0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ea2303-0225-4601-be01-1205a1eda87d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ad1caa-663d-48b3-a598-4d80e6252569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Volume volume-12ea2303-0225-4601-be01-1205a1eda87d (12ea2303-0225-4601-be01-1205a1eda87d): created successfully Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ad1caa-663d-48b3-a598-4d80e6252569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Flow 'volume_create_manager' (8b18d3b8-4619-41c2-96e9-ab5cda257d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-29ebe567-a929-46f3-a3cd-c8319cc6fecd tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created volume successfully. Nov 05 17:54:20 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a 1073741824" returned: 0 in 0.414s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:20 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a Nov 05 17:54:20 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:21 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-12ea2303-0225-4601-be01-1205a1eda87d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392d4cd4-3981-43d1-9759-fdc49cf3203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6e87b622cc46dd9beafa90dbf755be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:19Z,use_quota=True,user_id='6be21d64f779470f99e607b583e811bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Creating volume 392d4cd4-3981-43d1-9759-fdc49cf3203c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14d54ca-c21a-4ef7-b479-e26fb31555ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:21 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c 1073741824 Nov 05 17:54:21 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f2199c-1fda-4037-9116-be4ac4d220ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-12ea2303-0225-4601-be01-1205a1eda87d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Volume volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a (c9b41640-8764-4c4e-ae2e-5bdb0809323a): created successfully Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f2199c-1fda-4037-9116-be4ac4d220ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Flow 'volume_create_manager' (e0100976-b514-4bcb-94f1-3d7198801341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-235bedb9-b4e0-4c15-8bd4-ae2fe626816b tempest-VolumeDependencyTests-660948761 None] Created volume successfully. Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-12ea2303-0225-4601-be01-1205a1eda87d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-12ea2303-0225-4601-be01-1205a1eda87d" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[efafd11a-63e7-4e15-bf11-4fadfb29be67]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:21 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d Nov 05 17:54:21 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:21 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c 1073741824" returned: 0 in 0.446s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:21 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c Nov 05 17:54:21 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:21 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:21 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d Nov 05 17:54:21 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:21 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567422402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7632c894-b367-466d-b8d0-9305583aac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:20Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Creating volume 7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bc0f4e-2036-44be-b9f8-63c088299c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392d4cd4-3981-43d1-9759-fdc49cf3203c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe471e3c-f61c-46f3-83be-66bf3dec45a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:21 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 1073741824 Nov 05 17:54:21 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:21 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-12ea2303-0225-4601-be01-1205a1eda87d" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Volume volume-392d4cd4-3981-43d1-9759-fdc49cf3203c (392d4cd4-3981-43d1-9759-fdc49cf3203c): created successfully Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe471e3c-f61c-46f3-83be-66bf3dec45a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Flow 'volume_create_manager' (44252b11-3267-449b-bb4b-680583677125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-12ea2303-0225-4601-be01-1205a1eda87d" released by "delete_volume" :: held 0.747s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-269641ae-9108-4a60-8f0b-4b9311d7b13d tempest-CinderUnicodeTest-1787438813 None] Created volume successfully. Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created reservations ['9d83c0ac-a4b0-4186-af59-452f3ca404f7', '08bdf352-c28b-4863-b9b5-e79c3dadc8b7', '7a0fb747-3652-4d2c-8908-0c821bf81946', '46131f6a-f2d4-473d-926e-57e9c378a749'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:22 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:22 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-c46317e2-f649-4eb2-8bb7-732a851ee5c8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-c46317e2-f649-4eb2-8bb7-732a851ee5c8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-c46317e2-f649-4eb2-8bb7-732a851ee5c8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-c46317e2-f649-4eb2-8bb7-732a851ee5c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:22 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b412eb-b237-4b0d-aea4-a09370029874]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Deleted volume successfully. Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-09fcf4e1-c9d6-4c23-a72a-d009f8bc4487 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-12ea2303-0225-4601-be01-1205a1eda87d-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:22 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 1073741824" returned: 0 in 0.627s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:22 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 Nov 05 17:54:22 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:22 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 Nov 05 17:54:22 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:22 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:22 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.502s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:22 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8 Nov 05 17:54:22 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b3f2b2-bc3a-40aa-b185-6540657512ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7632c894-b367-466d-b8d0-9305583aac41', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5163b4-6851-4de9-bdeb-9151441c69c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Creating offline snapshot e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf of volume c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:54:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Volume volume-7632c894-b367-466d-b8d0-9305583aac41 (7632c894-b367-466d-b8d0-9305583aac41): created successfully Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5163b4-6851-4de9-bdeb-9151441c69c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (cb0fd398-bc53-4549-b098-10aeb1bc99fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ad6532-4cb6-4dd6-ae34-6112f0cb1877]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f3be299c-3756-41aa-95ee-0a99d93e67b0 tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:54:22 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a Nov 05 17:54:22 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:23 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c46317e2-f649-4eb2-8bb7-732a851ee5c8" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-c46317e2-f649-4eb2-8bb7-732a851ee5c8" released by "delete_volume" :: held 0.712s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created reservations ['e98c666d-89ae-45fe-8086-425c4b89dbe2', 'c895feec-f38c-47d0-884e-066e519f3359', '7abcd18a-630c-49ce-8298-f6d0225f4e30', '04aa823e-f5d5-4d3a-849a-28ddb757bea2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:23 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:23 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:23 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:23 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf 1G Nov 05 17:54:23 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-ed04cb21-0a09-4624-adbf-705f193f5342-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:23 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.301s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Deleted volume successfully. Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-ed04cb21-0a09-4624-adbf-705f193f5342-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2711277-2204-4548-98ee-05568a06e4fb tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-c46317e2-f649-4eb2-8bb7-732a851ee5c8-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-ed04cb21-0a09-4624-adbf-705f193f5342" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-ed04cb21-0a09-4624-adbf-705f193f5342" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beb7422-7216-44d4-bd0a-fbc24fd402b7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Flow 'volume_create_manager' (47608924-a28d-4130-a8ce-8cff20cc86ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd31ad9-0e3c-4f5c-a701-38a0719d42f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd31ad9-0e3c-4f5c-a701-38a0719d42f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1308155358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5677d5c-7ca8-477f-83b5-41bbffd2e6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6e87b622cc46dd9beafa90dbf755be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:24Z,use_quota=True,user_id='6be21d64f779470f99e607b583e811bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9539fc82-78ed-48fa-b4c7-2f0fe829f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9539fc82-78ed-48fa-b4c7-2f0fe829f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313e3b19-1a46-45ca-9300-ad1d09bf46ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313e3b19-1a46-45ca-9300-ad1d09bf46ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5677d5c-7ca8-477f-83b5-41bbffd2e6ad', 'volume_name': 'volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f62960-29da-49c5-95de-bf8f11e68fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f62960-29da-49c5-95de-bf8f11e68fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf144908-85e7-471c-b088-a1aa36dae422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Volume a5677d5c-7ca8-477f-83b5-41bbffd2e6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad', 'volume_size': 1} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:23 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 Nov 05 17:54:23 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:23 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf 1G" returned: 0 in 0.593s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:23 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf Nov 05 17:54:23 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:24 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342" returned: 0 in 0.443s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:24 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342 Nov 05 17:54:24 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:24 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf is being set with open permissions: ugo+rw Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:24 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf Nov 05 17:54:24 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:24 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-ed04cb21-0a09-4624-adbf-705f193f5342" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-ed04cb21-0a09-4624-adbf-705f193f5342" released by "delete_volume" :: held 0.761s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created reservations ['ce67ce33-e94e-467d-b166-113d43032b11', 'f2f6bc3b-7bb2-413d-996a-e8b83bd548c2', '8e4c833b-4d11-46d0-8c57-44b2b36c0a1f', 'f8d2039d-9aa4-4e09-aaa4-9092f4405b6e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:24 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:24 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.info Nov 05 17:54:24 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:24 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:24 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-9d3ec361-dbeb-4cdb-a9d4-df28220409c0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-9d3ec361-dbeb-4cdb-a9d4-df28220409c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-9d3ec361-dbeb-4cdb-a9d4-df28220409c0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:24 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.info" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.info is being set with open permissions: ugo+rw Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-9d3ec361-dbeb-4cdb-a9d4-df28220409c0" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:24 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.info Nov 05 17:54:24 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:24 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b98f0-3d2b-4dbd-b98d-7e0534c7851f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Deleted volume successfully. Nov 05 17:54:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7c9b8192-198a-4a95-a78e-5ca513dda0a9 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-ed04cb21-0a09-4624-adbf-705f193f5342-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:24 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 Nov 05 17:54:24 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:25 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.info" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.298s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1308155358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5677d5c-7ca8-477f-83b5-41bbffd2e6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6e87b622cc46dd9beafa90dbf755be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:24Z,use_quota=True,user_id='6be21d64f779470f99e607b583e811bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Creating volume a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:25 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:25 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad 1073741824 Nov 05 17:54:25 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8676df2a-0532-43a2-bd91-49ba0b6e4c58 tempest-VolumeDependencyTests-660948761 None] Create snapshot completed successfully Nov 05 17:54:25 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:25 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0 Nov 05 17:54:25 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:25 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-9d3ec361-dbeb-4cdb-a9d4-df28220409c0" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-9d3ec361-dbeb-4cdb-a9d4-df28220409c0" released by "delete_volume" :: held 0.697s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created reservations ['49561907-31ca-4e1e-8e5c-1855d5f6001c', '6b470159-36a7-47a3-a8c9-1fce594bf6ed', '71412176-d110-4111-835a-2064f20ce00f', 'fb3684f0-ce20-477f-98d8-051c759beb4d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:25 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad 1073741824" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:25 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:25 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:25 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad Nov 05 17:54:25 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-f11699cd-642a-4b9b-9063-9e1e849ef051-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-f11699cd-642a-4b9b-9063-9e1e849ef051-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:25 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.321s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Deleted volume successfully. Nov 05 17:54:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-f11699cd-642a-4b9b-9063-9e1e849ef051" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-f11699cd-642a-4b9b-9063-9e1e849ef051" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-182ad925-fdf2-4145-a6d0-d0f77e27f11a tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-9d3ec361-dbeb-4cdb-a9d4-df28220409c0-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:26 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" returned: 0 in 0.388s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6882395-abcc-4c62-93ad-ef31d46fc9f0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.075s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd of volume 7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf144908-85e7-471c-b088-a1aa36dae422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e3ffb2-c2bd-4803-a6a1-f23e9ad89c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f0d248-6f7a-423e-b5fd-19827aa0c5f4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Volume volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad (a5677d5c-7ca8-477f-83b5-41bbffd2e6ad): created successfully Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e3ffb2-c2bd-4803-a6a1-f23e9ad89c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Flow 'volume_create_manager' (47608924-a28d-4130-a8ce-8cff20cc86ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Flow 'volume_create_manager' (1b5143f2-1e61-4a83-a376-ad2dc9c7d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63562e62-c560-456f-907f-3640e762a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:26 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 Nov 05 17:54:26 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-731cd614-d385-4e67-bbce-2e39f0350705 tempest-CinderUnicodeTest-1787438813 None] Created volume successfully. Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63562e62-c560-456f-907f-3640e762a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2065152496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72045c0-342f-447c-8932-1e987dc7d289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ab07dc9004fe28485e858629bff04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:26Z,use_quota=True,user_id='b29181c01a7f4d528ad2471097a2ed22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8383576-93ac-4ff9-b917-bd6911a40975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8383576-93ac-4ff9-b917-bd6911a40975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f6c273-622c-4e1a-8829-31284572c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f6c273-622c-4e1a-8829-31284572c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd72045c0-342f-447c-8932-1e987dc7d289', 'volume_name': 'volume-d72045c0-342f-447c-8932-1e987dc7d289', 'volume_size': 1, 'snapshot_id': 'e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7527a09e-3cc8-431d-a140-77a3c8965002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:26 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 Nov 05 17:54:26 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7527a09e-3cc8-431d-a140-77a3c8965002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad83e9f-f8a5-47bb-9a25-25b5450e4deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Volume d72045c0-342f-447c-8932-1e987dc7d289: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d72045c0-342f-447c-8932-1e987dc7d289', 'volume_size': 1, 'snapshot_id': 'e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf'} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:26 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:26 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051 Nov 05 17:54:26 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:26 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:26 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd 1G Nov 05 17:54:26 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:26 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f11699cd-642a-4b9b-9063-9e1e849ef051" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-f11699cd-642a-4b9b-9063-9e1e849ef051" released by "delete_volume" :: held 0.720s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created reservations ['42b16b51-945f-4614-8791-d8e31234fcf8', '85ca6517-a84f-4b32-bb1d-20d8e5bf6260', '83f0c187-7680-4880-ae76-362727608704', '03e1e072-fe10-4641-81cb-cd2610bb9e3c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:26 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:26 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:26 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd 1G" returned: 0 in 0.448s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7632c894-b367-466d-b8d0-9305583aac41 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:26 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7632c894-b367-466d-b8d0-9305583aac41 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd Nov 05 17:54:26 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-43c2a28e-a3cc-4647-b00a-e191acc1bad6-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:27 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-43c2a28e-a3cc-4647-b00a-e191acc1bad6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.294s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Deleted volume successfully. Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-43c2a28e-a3cc-4647-b00a-e191acc1bad6" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-43c2a28e-a3cc-4647-b00a-e191acc1bad6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Deleting offline snapshot 43c2a28e-a3cc-4647-b00a-e191acc1bad6 of volume 5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] snapshot_file for this snap is: volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eca1915-d714-4ac9-afc9-2a1726d54517 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-f11699cd-642a-4b9b-9063-9e1e849ef051-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[179ef33c-6e10-4926-ad78-ac78619d2d34]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:27 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7632c894-b367-466d-b8d0-9305583aac41 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:27 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd is being set with open permissions: ugo+rw Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:27 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd Nov 05 17:54:27 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:27 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 Nov 05 17:54:27 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:27 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:27 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6" returned: 0 in 0.381s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:54:27 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.info Nov 05 17:54:27 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb31d049-abd6-462d-9096-1454ebcd9fcf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:27 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 Nov 05 17:54:27 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:27 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.info" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:27 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.info is being set with open permissions: ugo+rw Nov 05 17:54:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:27 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.info Nov 05 17:54:27 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:28 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:28 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 Nov 05 17:54:28 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:28 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.info" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.889s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-quobyte-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf-d72045c0-342f-447c-8932-1e987dc7d289" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf-d72045c0-342f-447c-8932-1e987dc7d289" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Creating volume d72045c0-342f-447c-8932-1e987dc7d289 from snapshot e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-quobyte-d72045c0-342f-447c-8932-1e987dc7d289" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-52bfae86-cf50-4b87-a22f-6b754fb8c7fb tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-d72045c0-342f-447c-8932-1e987dc7d289" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] snapshot: e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf, volume: d72045c0-342f-447c-8932-1e987dc7d289, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0244da4-8dec-47f4-9a03-409911cdcd24]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:28 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:28 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6 Nov 05 17:54:28 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:28 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf Nov 05 17:54:28 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:28 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44.43c2a28e-a3cc-4647-b00a-e191acc1bad6" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-43c2a28e-a3cc-4647-b00a-e191acc1bad6" released by "_delete_snapshot" :: held 1.423s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:28 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" released by "delete_snapshot" :: held 1.455s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e93fd-3c36-40d9-98b1-11d7e95e187f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created reservations ['69968abd-7972-4970-87e1-f9dea3380c39', '22fe765b-6ad5-4a1c-8290-c8647d62023f', '0ce906b6-d12f-4103-b5e5-cc2b70917faf', '4be423c6-bab6-4c08-8449-6521f2f48e89'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:28 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a Nov 05 17:54:28 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Delete snapshot completed successfully. Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8e0e1d66-6e2f-4588-b84b-d9ba6b8f331d tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-43c2a28e-a3cc-4647-b00a-e191acc1bad6-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:28 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:54:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:29 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 Nov 05 17:54:29 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Lock "cinder-ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-7632c894-b367-466d-b8d0-9305583aac41" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-7632c894-b367-466d-b8d0-9305583aac41" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd of volume 7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[479e0684-badd-411f-bc69-35a6d153fc98]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-5e3b8e84-9a4c-4348-83c3-6cfca76aac44-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-5e3b8e84-9a4c-4348-83c3-6cfca76aac44-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "cinder-quobyte-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:29 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd Nov 05 17:54:29 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa020c-9bbe-409c-9643-4d32fa34ae24]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:29 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 Nov 05 17:54:29 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:29 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" returned: 0 in 0.648s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7632c894-b367-466d-b8d0-9305583aac41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f414f455-eeaa-4d7f-80e5-c984a368e2b6]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:30 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 Nov 05 17:54:30 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:30 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" returned: 0 in 0.810s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:30 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44 Nov 05 17:54:30 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:30 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41" returned: 0 in 0.653s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:30 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" returned: 0 in 0.452s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:30 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd Nov 05 17:54:30 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-quobyte-5e3b8e84-9a4c-4348-83c3-6cfca76aac44" released by "delete_volume" :: held 1.341s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Created reservations ['ce05729b-c404-4729-b9e3-41b016b7ce4e', '03af0c40-57ab-4359-af4d-e6eb53d72ea3', '83f4c1c8-45f2-4a00-8575-868f5af634f0', '2bf3a9f6-4689-49e9-8109-ece748edbde1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:31 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:31 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:31 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" returned: 0 in 0.649s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:31 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd Nov 05 17:54:31 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:31 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.433s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Deleted volume successfully. Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1cbfef91-9175-43de-aaf0-e0dbed4a3748 tempest-CreateVolumesFromSnapshotTest-1270421555 None] Lock "cinder-5e3b8e84-9a4c-4348-83c3-6cfca76aac44-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:31 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41.ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd" released by "_delete_snapshot" :: held 2.547s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-7632c894-b367-466d-b8d0-9305583aac41" released by "delete_snapshot" :: held 2.581s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Created reservations ['1883848c-4a1a-47f7-af87-b2122cb22004', 'd3b21924-a8a9-4108-889a-731af5a1f003', 'abf16791-1bf3-481a-b6ec-7c26ff3f591c', '734a2200-d751-47cb-84a4-a20cc307a356'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:54:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8fb0eea-542a-4084-a3fa-07bb72b72ebc tempest-ProjectMemberTests-1523020904 None] Lock "cinder-ff0ffceb-b6d6-4508-88b7-9a9b5a3488bd-delete_snapshot" released by "delete_snapshot" :: held 2.842s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-7632c894-b367-466d-b8d0-9305583aac41-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-7632c894-b367-466d-b8d0-9305583aac41-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-7632c894-b367-466d-b8d0-9305583aac41" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-7632c894-b367-466d-b8d0-9305583aac41" acquired by "delete_volume" :: waited 0.044s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3436d8-06cb-4733-8cfb-c3d3510280f7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:33 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 Nov 05 17:54:33 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:33 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41" returned: 0 in 0.742s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:33 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41 Nov 05 17:54:33 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:34 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-7632c894-b367-466d-b8d0-9305583aac41" returned: 0 in 0.525s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-7632c894-b367-466d-b8d0-9305583aac41" released by "delete_volume" :: held 1.399s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Created reservations ['19864de1-85f3-4bd1-86b7-1919b40cfc00', '65fa65c1-f254-4a66-9930-0588b05b612d', 'eddab91c-b076-49d2-87e4-9156c8c00517', '0d6e7d38-b6cf-4bc2-a2a4-571e9f11987c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:34 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:34 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:35 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.563s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:54:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-16455de2-fced-44ec-af70-41495175edb3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-7632c894-b367-466d-b8d0-9305583aac41-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (6aa85f5e-674b-4af8-a3ed-df0225b865e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee98351a-d46d-4a70-8638-7246ab1e0142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee98351a-d46d-4a70-8638-7246ab1e0142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879028623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37f0b67-b9e4-4084-b79d-f6584e59399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:36Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425174b8-02ff-45ec-a0e7-834c8e581bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425174b8-02ff-45ec-a0e7-834c8e581bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc9ae19-2c3e-45bb-99cf-ece66fefa0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc9ae19-2c3e-45bb-99cf-ece66fefa0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37f0b67-b9e4-4084-b79d-f6584e59399f', 'volume_name': 'volume-b37f0b67-b9e4-4084-b79d-f6584e59399f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5637663c-0c3f-4eb9-b293-9a323e7ed8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5637663c-0c3f-4eb9-b293-9a323e7ed8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5389a6-7cc5-4773-ba81-40f5f6c92bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Volume b37f0b67-b9e4-4084-b79d-f6584e59399f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37f0b67-b9e4-4084-b79d-f6584e59399f', 'volume_size': 1} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:36 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289" returned: 0 in 7.473s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:54:36 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Converted 1024.00 MB image at 137.00 MB/s Nov 05 17:54:36 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 is being set with open permissions: ugo+rw Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:36 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 Nov 05 17:54:36 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:36 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-d72045c0-342f-447c-8932-1e987dc7d289" released by "_copy_volume_from_snapshot" :: held 8.512s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf-d72045c0-342f-447c-8932-1e987dc7d289" released by "_create_volume_from_snapshot" :: held 8.601s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.632s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.684s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Creating offline snapshot 5606fcda-6620-42be-8b80-3b02dab2c76d of volume a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad83e9f-f8a5-47bb-9a25-25b5450e4deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d72045c0-342f-447c-8932-1e987dc7d289', 'volume_size': 1, 'snapshot_id': 'e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4d8470-864a-45c5-9d27-1436c8a848ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a74dc-57ac-4af3-8d4e-d56756ecbd0a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Volume volume-d72045c0-342f-447c-8932-1e987dc7d289 (d72045c0-342f-447c-8932-1e987dc7d289): created successfully Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4d8470-864a-45c5-9d27-1436c8a848ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Flow 'volume_create_manager' (1b5143f2-1e61-4a83-a376-ad2dc9c7d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6e083859-69c3-4753-960b-897f3716ea8f tempest-VolumeDependencyTests-660948761 None] Created volume successfully. Nov 05 17:54:36 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad Nov 05 17:54:36 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-quobyte-c9b41640-8764-4c4e-ae2e-5bdb0809323a" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-c9b41640-8764-4c4e-ae2e-5bdb0809323a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-quobyte-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:37 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Deleting offline snapshot e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf of volume c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] snapshot_file for this snap is: volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" returned: 0 in 0.421s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c97709-5188-4bde-8ecf-7a4456acd6e5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:37 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d 1G Nov 05 17:54:37 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:37 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf Nov 05 17:54:37 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:37 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:54:37 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d 1G" returned: 0 in 0.439s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6721f-7142-4a13-8a84-b89ba2ba20c9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:37 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d Nov 05 17:54:37 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:37 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a Nov 05 17:54:37 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:38 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:38 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d is being set with open permissions: ugo+rw Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:38 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d Nov 05 17:54:38 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:38 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:38 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a" returned: 0 in 0.579s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:38 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf Nov 05 17:54:38 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:38 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.info Nov 05 17:54:38 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:38 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.info" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:38 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.info is being set with open permissions: ugo+rw Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:38 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.info Nov 05 17:54:38 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:38 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:38 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf Nov 05 17:54:38 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:38 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.info" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879028623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37f0b67-b9e4-4084-b79d-f6584e59399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:36Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Creating volume b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:38 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:38 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a.e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:38 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f 1073741824 Nov 05 17:54:38 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf" released by "_delete_snapshot" :: held 1.772s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-685155ba-e093-4920-baa9-af4a6a3022d0 tempest-CinderUnicodeTest-1787438813 None] Create snapshot completed successfully Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-c9b41640-8764-4c4e-ae2e-5bdb0809323a" released by "delete_snapshot" :: held 1.806s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Created reservations ['9dee4d7e-9f95-4686-ae8b-6efbea83a191', 'c0571bcd-af2f-47ed-be46-ce25048c019c', '130ac49d-4898-4291-b22a-be7874199ecb', 'e0035d88-3b0e-44d0-b8a4-8bda7c280426'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Delete snapshot completed successfully. Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e932945a-4c88-4567-95eb-7d6823d70a28 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-e2e32137-a8d1-4e9e-9a22-4930a4ee3fcf-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-c9b41640-8764-4c4e-ae2e-5bdb0809323a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Lock "cinder-c9b41640-8764-4c4e-ae2e-5bdb0809323a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-quobyte-c9b41640-8764-4c4e-ae2e-5bdb0809323a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-c9b41640-8764-4c4e-ae2e-5bdb0809323a" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:39 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f 1073741824" returned: 0 in 0.563s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba46150-6386-466a-a71d-831912dc59d7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:39 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f Nov 05 17:54:39 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:39 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a Nov 05 17:54:39 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "cinder-5606fcda-6620-42be-8b80-3b02dab2c76d-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:39 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-5606fcda-6620-42be-8b80-3b02dab2c76d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "cinder-quobyte-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5389a6-7cc5-4773-ba81-40f5f6c92bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37f0b67-b9e4-4084-b79d-f6584e59399f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6636cd83-5863-47b0-ac41-5cd9f7757de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "cinder-quobyte-5606fcda-6620-42be-8b80-3b02dab2c76d" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-5606fcda-6620-42be-8b80-3b02dab2c76d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Deleting offline snapshot 5606fcda-6620-42be-8b80-3b02dab2c76d of volume a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:54:39 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] snapshot_file for this snap is: volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:54:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Volume volume-b37f0b67-b9e4-4084-b79d-f6584e59399f (b37f0b67-b9e4-4084-b79d-f6584e59399f): created successfully Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6636cd83-5863-47b0-ac41-5cd9f7757de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (6aa85f5e-674b-4af8-a3ed-df0225b865e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a" returned: 0 in 0.487s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e035938d-3228-487d-be76-ca04e393e61c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:40 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a Nov 05 17:54:40 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a6aa1ccd-69a3-48e9-9e78-f985d6bfd341 tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:54:40 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d Nov 05 17:54:40 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:40 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-c9b41640-8764-4c4e-ae2e-5bdb0809323a" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-c9b41640-8764-4c4e-ae2e-5bdb0809323a" released by "delete_volume" :: held 0.854s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Created reservations ['181c8297-a194-4f82-b8af-f0cd5395e01e', 'e2e5a742-e515-4c0e-968a-649a12f6224f', 'ce3a6561-89e2-41da-8fde-cc3d75a020a3', '1666486e-84b8-4fd0-afba-6d79b4f8ab47'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:40 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d" returned: 0 in 0.450s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:54:40 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:40 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbec8656-91d5-4db5-a531-88cbb2df6c29]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-d72045c0-342f-447c-8932-1e987dc7d289-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-d72045c0-342f-447c-8932-1e987dc7d289-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:40 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad Nov 05 17:54:40 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Acquiring lock "cinder-quobyte-d72045c0-342f-447c-8932-1e987dc7d289" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-d72045c0-342f-447c-8932-1e987dc7d289" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e3e7c-35e5-418d-9ded-14e0dafe1d7e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:40 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Deleted volume successfully. Nov 05 17:54:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dc40c963-3505-4f1c-b858-f8f235c7afab tempest-VolumeDependencyTests-660948761 None] Lock "cinder-c9b41640-8764-4c4e-ae2e-5bdb0809323a-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:40 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 Nov 05 17:54:40 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:41 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" returned: 0 in 0.534s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:41 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d Nov 05 17:54:41 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:41 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289" returned: 0 in 0.486s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:41 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289 Nov 05 17:54:41 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot 2e590340-622c-4c6d-a5eb-2fdb13202c9a of volume b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[359e354c-8600-4dc8-bdb9-6b9b6f0e25b0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:41 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f Nov 05 17:54:41 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:41 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:41 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-d72045c0-342f-447c-8932-1e987dc7d289" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d" returned: 0 in 0.500s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-quobyte-d72045c0-342f-447c-8932-1e987dc7d289" released by "delete_volume" :: held 0.886s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:41 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d Nov 05 17:54:41 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Created reservations ['366d24d8-a66c-4e4d-a517-2cbad423859d', 'd9e0fc64-0326-4f57-b074-2c1da414a03b', '597e24fc-9fc3-4c38-bd75-d79fcc727a73', '5eb98f93-0305-45eb-ac51-0fafcfdd623b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:41 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:41 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:41 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f" returned: 0 in 0.555s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:41 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a 1G Nov 05 17:54:41 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:41 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad.5606fcda-6620-42be-8b80-3b02dab2c76d" returned: 0 in 0.455s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-5606fcda-6620-42be-8b80-3b02dab2c76d" released by "_delete_snapshot" :: held 2.143s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" released by "delete_snapshot" :: held 2.177s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Created reservations ['e439fe11-0e7a-4727-b93f-5a2714d69749', '2a0fa49c-ba58-4213-ab3b-ee2a96c24b19', '28961251-cdb4-4d84-b8fc-7333504e9408', '03f44695-cb72-487f-9f55-b1ac326751bd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:42 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Deleted volume successfully. Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdb5189f-24d5-4517-82a7-24efdb718556 tempest-VolumeDependencyTests-660948761 None] Lock "cinder-d72045c0-342f-447c-8932-1e987dc7d289-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Delete snapshot completed successfully. Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c98d1100-571d-493d-a1c9-354e529ac1fd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-5606fcda-6620-42be-8b80-3b02dab2c76d-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:42 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a 1G" returned: 0 in 0.603s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37f0b67-b9e4-4084-b79d-f6584e59399f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:42 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37f0b67-b9e4-4084-b79d-f6584e59399f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a Nov 05 17:54:42 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:42 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37f0b67-b9e4-4084-b79d-f6584e59399f -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a" returned: 0 in 0.321s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:42 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a is being set with open permissions: ugo+rw Nov 05 17:54:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:42 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a Nov 05 17:54:42 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "cinder-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "cinder-quobyte-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:43 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d8c1c-8646-4b8d-9b71-c463f8876969]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:43 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.info Nov 05 17:54:43 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:43 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad Nov 05 17:54:43 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:43 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.info" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:43 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.info is being set with open permissions: ugo+rw Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:43 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.info Nov 05 17:54:43 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:43 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" returned: 0 in 0.405s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:43 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad Nov 05 17:54:43 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:43 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.info" returned: 0 in 0.301s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-90804b88-4f49-449d-a677-867563e4194a tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:54:43 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad" released by "delete_volume" :: held 0.791s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Created reservations ['c25baef9-dca2-4629-aab7-1747a133cdd0', 'f5a7fee5-7553-4fb8-8152-41caa06aec71', '49edeab1-4fe1-4f89-9468-d05a957368d5', '46df426d-be93-4bc8-b803-ddade577f15e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:44 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:44 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "cinder-392d4cd4-3981-43d1-9759-fdc49cf3203c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-392d4cd4-3981-43d1-9759-fdc49cf3203c-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "cinder-quobyte-392d4cd4-3981-43d1-9759-fdc49cf3203c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:44 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-2e590340-622c-4c6d-a5eb-2fdb13202c9a-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-392d4cd4-3981-43d1-9759-fdc49cf3203c" acquired by "delete_volume" :: waited 0.055s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Deleted volume successfully. Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2e590340-622c-4c6d-a5eb-2fdb13202c9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-b37f0b67-b9e4-4084-b79d-f6584e59399f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0abcf1b-54b4-41d0-ab43-2c3520a99fe8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-b37f0b67-b9e4-4084-b79d-f6584e59399f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-2e590340-622c-4c6d-a5eb-2fdb13202c9a" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a200e2-bafc-4d19-a41d-a9afc193a6cd tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-a5677d5c-7ca8-477f-83b5-41bbffd2e6ad-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2e590340-622c-4c6d-a5eb-2fdb13202c9a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot 2e590340-622c-4c6d-a5eb-2fdb13202c9a of volume b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd912ee9-26c4-4512-8a0d-ac450606b80c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:44 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c Nov 05 17:54:44 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:44 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a Nov 05 17:54:44 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:45 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:45 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c Nov 05 17:54:45 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:45 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a" returned: 0 in 0.559s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37f0b67-b9e4-4084-b79d-f6584e59399f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c9a6c-349d-4910-8a72-9ce16c3f3a18]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:45 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-392d4cd4-3981-43d1-9759-fdc49cf3203c" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:45 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f Nov 05 17:54:45 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-quobyte-392d4cd4-3981-43d1-9759-fdc49cf3203c" released by "delete_volume" :: held 0.881s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Created reservations ['145a0cd3-a239-405b-a319-b73572c5ec37', 'b99546a0-882a-4846-9d19-c2489abd7e2b', '1f5e9bb0-40c6-42f5-ae88-b963e1f41ba2', '512c2f0e-b251-4dcf-9182-8b3d762f6814'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:45 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:45 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:45 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f" returned: 0 in 0.418s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:45 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a Nov 05 17:54:45 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:45 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Deleted volume successfully. Nov 05 17:54:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4fc03e3e-376f-4ae6-8c69-102cea257407 tempest-CinderUnicodeTest-1787438813 None] Lock "cinder-392d4cd4-3981-43d1-9759-fdc49cf3203c-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3e429ebc-c153-4fb1-996d-09155fec4cf3 tempest-ProjectAdminTests-414914598 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552764892578, 'free_capacity_gb': 1773.4552764892578, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 17:54:46 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a" returned: 0 in 0.526s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:46 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a Nov 05 17:54:46 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:46 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f.2e590340-622c-4c6d-a5eb-2fdb13202c9a" returned: 0 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2e590340-622c-4c6d-a5eb-2fdb13202c9a" released by "_delete_snapshot" :: held 2.026s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-b37f0b67-b9e4-4084-b79d-f6584e59399f" released by "delete_snapshot" :: held 2.058s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Created reservations ['7356f1ad-3162-426e-9dee-85139f6d2fda', 'fb0d19a7-a4dc-49ad-b980-1d9ec0f097c9', '17c75af3-c17e-4672-bea6-2805291ef231', 'eae9a4fb-40b4-4733-aeba-b09e48bdb8e4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:54:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-081350fc-8d15-4007-a009-0e5d02be0cd5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2e590340-622c-4c6d-a5eb-2fdb13202c9a-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-b37f0b67-b9e4-4084-b79d-f6584e59399f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-b37f0b67-b9e4-4084-b79d-f6584e59399f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-b37f0b67-b9e4-4084-b79d-f6584e59399f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-b37f0b67-b9e4-4084-b79d-f6584e59399f" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9de41-0cf9-484f-816a-2b23da57e72e]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:48 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f Nov 05 17:54:48 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:48 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:48 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f Nov 05 17:54:48 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:48 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b37f0b67-b9e4-4084-b79d-f6584e59399f" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-b37f0b67-b9e4-4084-b79d-f6584e59399f" released by "delete_volume" :: held 0.926s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:48 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Created reservations ['19fa26fe-e5b7-44da-904b-48563e06003e', '3c94b476-4c9d-479b-8ab7-0b7d18ef0a73', '7bc34856-6114-4d7f-b043-2c0a34f401d8', 'c376d8b0-ef7e-49a0-8f02-8bb8219d9dea'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:49 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:49 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:49 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:54:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d1ef26c4-e14f-4810-98cf-53a460e14ef3 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-b37f0b67-b9e4-4084-b79d-f6584e59399f-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (2dda8e96-f60e-4934-b19b-43bc078cd526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828b12b9-3926-4540-bde4-2d548874dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=230,cinder:UPDATE=315,cinder:INSERT=79,cinder:DELETE=31 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828b12b9-3926-4540-bde4-2d548874dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1684710266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c75ed25-7f77-4124-b1e0-609c022e3a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:51Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a55bcf8-ee2d-46f8-be71-6a32653e1dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a55bcf8-ee2d-46f8-be71-6a32653e1dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fa98d8-1c45-4b85-8002-a57f33e282fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fa98d8-1c45-4b85-8002-a57f33e282fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c75ed25-7f77-4124-b1e0-609c022e3a48', 'volume_name': 'volume-2c75ed25-7f77-4124-b1e0-609c022e3a48', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05775aa5-5631-4b21-a9c6-7b730421160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05775aa5-5631-4b21-a9c6-7b730421160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe39f92-ceb3-4d46-9450-0fbbfbdac0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Volume 2c75ed25-7f77-4124-b1e0-609c022e3a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c75ed25-7f77-4124-b1e0-609c022e3a48', 'volume_size': 1} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1684710266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c75ed25-7f77-4124-b1e0-609c022e3a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:51Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Creating volume 2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:50 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:50 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 1073741824 Nov 05 17:54:50 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:51 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 1073741824" returned: 0 in 0.631s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=314,cinder:SELECT=237,cinder:INSERT=90,cinder:DELETE=24 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:51 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 Nov 05 17:54:51 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:51 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe39f92-ceb3-4d46-9450-0fbbfbdac0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c75ed25-7f77-4124-b1e0-609c022e3a48', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221d3d49-95ac-454c-bce0-432558b6d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Volume volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 (2c75ed25-7f77-4124-b1e0-609c022e3a48): created successfully Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221d3d49-95ac-454c-bce0-432558b6d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (2dda8e96-f60e-4934-b19b-43bc078cd526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ec7a16ed-5d6c-4de6-a1c4-7c3f7e82526e tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Flow 'volume_create_manager' (845889cf-c81e-4153-9df9-72c02da90b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461461a6-4f8c-47e8-8d5a-ae62f9ad7483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461461a6-4f8c-47e8-8d5a-ae62f9ad7483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419426495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76705ab1-5e87-4c72-bfdf-7f7314438eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8ad0ca2d0e40edb7a9c2e34fa0a44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:52Z,use_quota=True,user_id='aff6a7904e6a42eba0f4b08fb3e61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd35e30-64d7-4193-b25c-0a2f013291a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd35e30-64d7-4193-b25c-0a2f013291a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11993d0-f448-42d7-9572-961d1b7e36ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11993d0-f448-42d7-9572-961d1b7e36ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76705ab1-5e87-4c72-bfdf-7f7314438eaa', 'volume_name': 'volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced87aee-7c31-4673-ad9b-7ec841cc913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced87aee-7c31-4673-ad9b-7ec841cc913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7cbbd4-98c4-465f-9a98-ff865f61a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Volume 76705ab1-5e87-4c72-bfdf-7f7314438eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa', 'volume_size': 1} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419426495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76705ab1-5e87-4c72-bfdf-7f7314438eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8ad0ca2d0e40edb7a9c2e34fa0a44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:52Z,use_quota=True,user_id='aff6a7904e6a42eba0f4b08fb3e61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Creating volume 76705ab1-5e87-4c72-bfdf-7f7314438eaa {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:52 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:52 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa 1073741824 Nov 05 17:54:52 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:52 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa 1073741824" returned: 0 in 0.542s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:52 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa Nov 05 17:54:52 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:53 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7cbbd4-98c4-465f-9a98-ff865f61a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f05d28-1b1f-49fc-9613-f46594729cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Volume volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa (76705ab1-5e87-4c72-bfdf-7f7314438eaa): created successfully Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f05d28-1b1f-49fc-9613-f46594729cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Flow 'volume_create_manager' (845889cf-c81e-4153-9df9-72c02da90b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a38a1641-2da4-451f-90cb-5784df0e160b tempest-ProjectReaderTests-163714740 None] Created volume successfully. Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot fc122fd7-2791-48ee-8ced-c25c6cc3343c of volume 2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b75999c-aa3e-4350-b20a-a042a6a1ba8a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:53 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 Nov 05 17:54:53 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:53 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:53 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c 1G Nov 05 17:54:53 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:54 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c 1G" returned: 0 in 0.516s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:54 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c Nov 05 17:54:54 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Acquiring lock "cinder-76705ab1-5e87-4c72-bfdf-7f7314438eaa-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Lock "cinder-76705ab1-5e87-4c72-bfdf-7f7314438eaa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Acquiring lock "cinder-quobyte-76705ab1-5e87-4c72-bfdf-7f7314438eaa" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Lock "cinder-quobyte-76705ab1-5e87-4c72-bfdf-7f7314438eaa" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b6733-c92d-4284-9803-f23542ac74ba]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:54 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:54 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c is being set with open permissions: ugo+rw Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:54 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c Nov 05 17:54:54 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:54 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa Nov 05 17:54:54 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:54 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c" returned: 0 in 0.338s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:55 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa" returned: 0 in 0.446s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:55 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.info Nov 05 17:54:55 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:55 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa Nov 05 17:54:55 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:55 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.info" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:55 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.info is being set with open permissions: ugo+rw Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:55 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:55 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.info Nov 05 17:54:55 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-76705ab1-5e87-4c72-bfdf-7f7314438eaa" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Lock "cinder-quobyte-76705ab1-5e87-4c72-bfdf-7f7314438eaa" released by "delete_volume" :: held 0.785s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Created reservations ['1529b277-af43-492a-9a00-f307486438fc', 'c9818184-dffd-4adb-b81c-32286be8c0b5', '4931da52-a68c-448a-a210-28ff6b4f44d1', 'fb93b9b1-d8f2-459a-9ab7-1eed21607bae'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:55 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:55 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:55 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.info" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c4d9cbd7-90fc-4a36-9e78-45e75182e2c1 tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:54:55 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:54:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Deleted volume successfully. Nov 05 17:54:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-eedfb49f-ec01-481b-ae11-537dbeb131da tempest-ProjectReaderTests-163714740 None] Lock "cinder-76705ab1-5e87-4c72-bfdf-7f7314438eaa-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Flow 'volume_create_manager' (b4912c2a-c656-430d-929c-484784294544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0341c7e4-fe2a-4dd7-b47f-ada1c5fb4677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0341c7e4-fe2a-4dd7-b47f-ada1c5fb4677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981289352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3487814e-537c-44a0-b1b3-6ee3c4c9750c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8ad0ca2d0e40edb7a9c2e34fa0a44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:56Z,use_quota=True,user_id='aff6a7904e6a42eba0f4b08fb3e61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73124e88-c2a0-4658-bb96-f0fc7a759458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73124e88-c2a0-4658-bb96-f0fc7a759458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6258734-049f-4252-ad57-a181e7590f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6258734-049f-4252-ad57-a181e7590f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3487814e-537c-44a0-b1b3-6ee3c4c9750c', 'volume_name': 'volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a0d047-7824-4e99-b127-a4d4dd17dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a0d047-7824-4e99-b127-a4d4dd17dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8f28a6-77cb-40f6-acf2-9dd7745f7425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Volume 3487814e-537c-44a0-b1b3-6ee3c4c9750c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c', 'volume_size': 1} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981289352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3487814e-537c-44a0-b1b3-6ee3c4c9750c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8ad0ca2d0e40edb7a9c2e34fa0a44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:54:56Z,use_quota=True,user_id='aff6a7904e6a42eba0f4b08fb3e61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Creating volume 3487814e-537c-44a0-b1b3-6ee3c4c9750c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:54:56 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:56 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c 1073741824 Nov 05 17:54:56 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-fc122fd7-2791-48ee-8ced-c25c6cc3343c-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Lock "cinder-fc122fd7-2791-48ee-8ced-c25c6cc3343c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-2c75ed25-7f77-4124-b1e0-609c022e3a48" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2c75ed25-7f77-4124-b1e0-609c022e3a48" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-fc122fd7-2791-48ee-8ced-c25c6cc3343c" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-fc122fd7-2791-48ee-8ced-c25c6cc3343c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot fc122fd7-2791-48ee-8ced-c25c6cc3343c of volume 2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea710746-5d18-4545-85c7-560e7b9ebef9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:56 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c Nov 05 17:54:56 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:57 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c 1073741824" returned: 0 in 0.675s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:57 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c Nov 05 17:54:57 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:57 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c" returned: 0 in 0.606s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c75ed25-7f77-4124-b1e0-609c022e3a48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c77ae5b-7bc5-4d3f-88bc-5291927b541f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:57 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 Nov 05 17:54:57 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:57 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c" returned: 0 in 0.301s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8f28a6-77cb-40f6-acf2-9dd7745f7425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05cb43c-06e5-43df-90da-b1612ed87da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:54:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Volume volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c (3487814e-537c-44a0-b1b3-6ee3c4c9750c): created successfully Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05cb43c-06e5-43df-90da-b1612ed87da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Flow 'volume_create_manager' (b4912c2a-c656-430d-929c-484784294544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:54:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-25b93b56-09ad-4be7-927e-80a34c7298c9 tempest-ProjectReaderTests-163714740 None] Created volume successfully. Nov 05 17:54:57 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48" returned: 0 in 0.465s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:57 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c Nov 05 17:54:57 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:58 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c" returned: 0 in 0.541s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Acquiring lock "cinder-3487814e-537c-44a0-b1b3-6ee3c4c9750c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:58 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c Nov 05 17:54:58 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Lock "cinder-3487814e-537c-44a0-b1b3-6ee3c4c9750c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Acquiring lock "cinder-quobyte-3487814e-537c-44a0-b1b3-6ee3c4c9750c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Lock "cinder-quobyte-3487814e-537c-44a0-b1b3-6ee3c4c9750c" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[948fff8c-64ed-43c5-97a9-53c08fb9e878]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:58 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c Nov 05 17:54:58 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:58 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48.fc122fd7-2791-48ee-8ced-c25c6cc3343c" returned: 0 in 0.433s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-fc122fd7-2791-48ee-8ced-c25c6cc3343c" released by "_delete_snapshot" :: held 2.209s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2c75ed25-7f77-4124-b1e0-609c022e3a48" released by "delete_snapshot" :: held 2.239s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Created reservations ['8fa8cae0-d63a-4ffe-b2ec-d35b3d960df8', '7f3f2575-dea5-411f-9f00-eef3475c6b3e', '4c7368a4-882c-4aa9-bd01-837c669a6c06', 'e02fadaa-a386-42be-8759-179b887c6eff'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c0f2646-04cf-4d62-a7c6-78a6a242482b tempest-ProjectMemberTests-1523020904 None] Lock "cinder-fc122fd7-2791-48ee-8ced-c25c6cc3343c-delete_snapshot" released by "delete_snapshot" :: held 2.465s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:59 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c" returned: 0 in 0.528s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:59 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c Nov 05 17:54:59 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:59 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3487814e-537c-44a0-b1b3-6ee3c4c9750c" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Lock "cinder-quobyte-3487814e-537c-44a0-b1b3-6ee3c4c9750c" released by "delete_volume" :: held 0.878s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Created reservations ['5043a074-cd75-4a4a-9600-b1e970475d83', '61c8298c-50dc-47be-9c1e-60b40043a5df', '228c527d-faec-424f-96ec-d6ea764389d0', '726e9157-39f8-4ae3-b1ba-8fbee3be139d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:54:59 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:54:59 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-2c75ed25-7f77-4124-b1e0-609c022e3a48-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2c75ed25-7f77-4124-b1e0-609c022e3a48-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:54:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-2c75ed25-7f77-4124-b1e0-609c022e3a48" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:00 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2c75ed25-7f77-4124-b1e0-609c022e3a48" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.429s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Deleted volume successfully. Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b2b070-facb-43b0-870e-07c0dcfd9dd8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3c4827b6-a238-4f2f-a4ac-b08fc735c8c8 tempest-ProjectReaderTests-163714740 None] Lock "cinder-3487814e-537c-44a0-b1b3-6ee3c4c9750c-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:00 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 Nov 05 17:55:00 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:00 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:00 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48 Nov 05 17:55:00 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:00 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-2c75ed25-7f77-4124-b1e0-609c022e3a48" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2c75ed25-7f77-4124-b1e0-609c022e3a48" released by "delete_volume" :: held 0.824s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:00 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Created reservations ['2a3409cd-162f-4b75-942b-8667e87878cc', '64222fe3-a036-4d4e-85ed-f793d74f56bd', '1555457b-ca66-433b-b0af-c3625baa2e2f', 'cc0240b4-c310-4d76-a389-8402a920cf0f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:01 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:01 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:01 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a73e50ff-8e62-4f46-8c37-46c6e9fe8479 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2c75ed25-7f77-4124-b1e0-609c022e3a48-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (c146542a-0fcc-4750-ab39-28af23de8a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbf379d-9e35-4123-a917-be808a7651ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbf379d-9e35-4123-a917-be808a7651ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442712353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48849f49-abfa-44a3-b921-b75157eaade5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:02Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1c4488-b333-4490-a35a-a59f68ea5605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1c4488-b333-4490-a35a-a59f68ea5605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1828d0d-621b-407b-b5f0-3041b72a202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1828d0d-621b-407b-b5f0-3041b72a202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48849f49-abfa-44a3-b921-b75157eaade5', 'volume_name': 'volume-48849f49-abfa-44a3-b921-b75157eaade5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c3332c-4ff7-454e-9989-bae57a7a6fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c3332c-4ff7-454e-9989-bae57a7a6fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee168b30-feeb-41a0-a08e-fc9097376cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Volume 48849f49-abfa-44a3-b921-b75157eaade5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48849f49-abfa-44a3-b921-b75157eaade5', 'volume_size': 1} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442712353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48849f49-abfa-44a3-b921-b75157eaade5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:02Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Creating volume 48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:01 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:01 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 1073741824 Nov 05 17:55:02 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:02 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 1073741824" returned: 0 in 0.599s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:02 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 Nov 05 17:55:02 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:02 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee168b30-feeb-41a0-a08e-fc9097376cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48849f49-abfa-44a3-b921-b75157eaade5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f9ecde-5c1c-4d4d-bd75-acc124b1ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Volume volume-48849f49-abfa-44a3-b921-b75157eaade5 (48849f49-abfa-44a3-b921-b75157eaade5): created successfully Nov 05 17:55:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f9ecde-5c1c-4d4d-bd75-acc124b1ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (c146542a-0fcc-4750-ab39-28af23de8a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6199d100-1629-4a79-9c6f-b934dee16e3d tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot 4a72a5ff-3569-4b79-b484-ee008e67169f of volume 48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a49df78-c51e-491c-a365-87aba9057938]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:04 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 Nov 05 17:55:04 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (671822bc-6a62-43e5-9d60-2fbfc13dd8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558af625-b55c-40ed-9d52-74580f502b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558af625-b55c-40ed-9d52-74580f502b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326563049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08a4eab-e77c-49d1-8de1-826b087cdcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:04Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f40257-373f-4534-8973-7c16660ecb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f40257-373f-4534-8973-7c16660ecb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fbc33b-9ee4-4240-808f-f14f1864fa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fbc33b-9ee4-4240-808f-f14f1864fa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08a4eab-e77c-49d1-8de1-826b087cdcde', 'volume_name': 'volume-a08a4eab-e77c-49d1-8de1-826b087cdcde', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776aea90-759c-480f-8205-28fa9afc0473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776aea90-759c-480f-8205-28fa9afc0473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78979ecf-7fc8-4c01-a945-de9c4e6ec3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Volume a08a4eab-e77c-49d1-8de1-826b087cdcde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08a4eab-e77c-49d1-8de1-826b087cdcde', 'volume_size': 1} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:04 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:04 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f 1G Nov 05 17:55:04 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:05 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f 1G" returned: 0 in 0.472s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48849f49-abfa-44a3-b921-b75157eaade5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:05 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48849f49-abfa-44a3-b921-b75157eaade5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f Nov 05 17:55:05 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:05 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48849f49-abfa-44a3-b921-b75157eaade5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:05 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f is being set with open permissions: ugo+rw Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:05 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f Nov 05 17:55:05 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:05 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:05 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.info Nov 05 17:55:05 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:05 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.info" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:05 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.info is being set with open permissions: ugo+rw Nov 05 17:55:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:05 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.info Nov 05 17:55:05 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:06 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.info" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326563049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08a4eab-e77c-49d1-8de1-826b087cdcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:04Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Creating volume a08a4eab-e77c-49d1-8de1-826b087cdcde {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:06 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde 1073741824 Nov 05 17:55:06 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9e9646c4-af7e-4c57-ab99-3cb781645ba0 tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:55:06 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde 1073741824" returned: 0 in 0.562s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:06 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde Nov 05 17:55:06 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:07 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78979ecf-7fc8-4c01-a945-de9c4e6ec3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08a4eab-e77c-49d1-8de1-826b087cdcde', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f9025c-c373-4862-9332-a39c79c165e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Volume volume-a08a4eab-e77c-49d1-8de1-826b087cdcde (a08a4eab-e77c-49d1-8de1-826b087cdcde): created successfully Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f9025c-c373-4862-9332-a39c79c165e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (671822bc-6a62-43e5-9d60-2fbfc13dd8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-24a3a764-603d-42ef-be27-cc45ec0dda96 tempest-ProjectReaderTests-559441452 None] Created volume successfully. Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-4a72a5ff-3569-4b79-b484-ee008e67169f-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-4a72a5ff-3569-4b79-b484-ee008e67169f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-48849f49-abfa-44a3-b921-b75157eaade5" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-48849f49-abfa-44a3-b921-b75157eaade5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-4a72a5ff-3569-4b79-b484-ee008e67169f" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-4a72a5ff-3569-4b79-b484-ee008e67169f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot 4a72a5ff-3569-4b79-b484-ee008e67169f of volume 48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[465c4b46-92fd-4b48-9449-5f007b0c1674]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:07 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f Nov 05 17:55:07 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:07 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f" returned: 0 in 0.412s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48849f49-abfa-44a3-b921-b75157eaade5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-a08a4eab-e77c-49d1-8de1-826b087cdcde-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dbef2a-966b-4cd3-870d-55fc669831cc]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Lock "cinder-a08a4eab-e77c-49d1-8de1-826b087cdcde-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-quobyte-a08a4eab-e77c-49d1-8de1-826b087cdcde" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-a08a4eab-e77c-49d1-8de1-826b087cdcde" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c6842-8c72-4133-9374-cd12c0c5969c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:08 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 Nov 05 17:55:08 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:08 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde Nov 05 17:55:08 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:08 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5" returned: 0 in 0.450s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:08 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f Nov 05 17:55:08 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:08 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde" returned: 0 in 0.425s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:08 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde Nov 05 17:55:08 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:08 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:08 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-a08a4eab-e77c-49d1-8de1-826b087cdcde" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:08 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-a08a4eab-e77c-49d1-8de1-826b087cdcde" released by "delete_volume" :: held 0.751s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:08 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Created reservations ['c40e6847-5186-4be4-b537-76c06eebee68', '68313190-43f5-49b1-9ead-dc8db027d74b', 'e76d96c0-c506-4895-89ec-30f66adf0d86', 'a42cec1a-7f0d-45af-a956-b0e608def88e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:08 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:08 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:08 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5.4a72a5ff-3569-4b79-b484-ee008e67169f" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-4a72a5ff-3569-4b79-b484-ee008e67169f" released by "_delete_snapshot" :: held 1.660s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-48849f49-abfa-44a3-b921-b75157eaade5" released by "delete_snapshot" :: held 1.696s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Created reservations ['47dc53d8-93d3-40d5-9c09-2639e6701805', '004e9cb7-1017-4f37-9d3c-8c7b7ee5f6ec', '7e638cb4-3041-4e08-af5b-6f5221407bc9', 'f17c5f2a-de37-49a3-b6db-952dcc0bae4a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:09 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Deleted volume successfully. Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-063ab9e2-3192-4903-8a2e-08f2ba7bb9cc tempest-ProjectReaderTests-559441452 None] Lock "cinder-a08a4eab-e77c-49d1-8de1-826b087cdcde-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac970b52-da16-4e4f-baf1-5a7c9d9e73f5 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-4a72a5ff-3569-4b79-b484-ee008e67169f-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-48849f49-abfa-44a3-b921-b75157eaade5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-48849f49-abfa-44a3-b921-b75157eaade5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-48849f49-abfa-44a3-b921-b75157eaade5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-48849f49-abfa-44a3-b921-b75157eaade5" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (00459e5f-1122-42b9-a96d-e1d10d4678b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0e15b5-1614-4d67-b935-00f7e65d1689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c72b9-e479-41fe-b769-ce0e7d7ba038]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0e15b5-1614-4d67-b935-00f7e65d1689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665377269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63efcee6-ee5d-44a6-8b3f-cf6ceb579c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:10Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78f0c3c-5ab9-47a8-a094-f7062140f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78f0c3c-5ab9-47a8-a094-f7062140f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb7378a-c9eb-4e1d-a220-401e498743d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb7378a-c9eb-4e1d-a220-401e498743d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63efcee6-ee5d-44a6-8b3f-cf6ceb579c88', 'volume_name': 'volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e1610c-566a-4586-8a12-7e50200785dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e1610c-566a-4586-8a12-7e50200785dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755e4766-570e-418c-9919-32a0504a0c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Volume 63efcee6-ee5d-44a6-8b3f-cf6ceb579c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88', 'volume_size': 1} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665377269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63efcee6-ee5d-44a6-8b3f-cf6ceb579c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:10Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Creating volume 63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:09 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:09 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 1073741824 Nov 05 17:55:09 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:09 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 Nov 05 17:55:09 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:10 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:10 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5 Nov 05 17:55:10 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:10 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 1073741824" returned: 0 in 0.529s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:10 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-48849f49-abfa-44a3-b921-b75157eaade5" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:10 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-48849f49-abfa-44a3-b921-b75157eaade5" released by "delete_volume" :: held 0.761s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:10 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Created reservations ['8247f741-5b72-4f5e-8fc8-774d9c2ce752', '3f2f4c08-2b54-4e08-acde-aecbe9a6c6bb', 'a790d4d5-1025-4dbb-9695-91c68bbcf826', '4bd3f7b7-d4d5-44f3-ac08-0a06e905b4d2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:10 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:10 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:10 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755e4766-570e-418c-9919-32a0504a0c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dfe0cd-6ef2-44f2-b7a4-3e88c927dd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:10 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Volume volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 (63efcee6-ee5d-44a6-8b3f-cf6ceb579c88): created successfully Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dfe0cd-6ef2-44f2-b7a4-3e88c927dd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (00459e5f-1122-42b9-a96d-e1d10d4678b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1a469f6c-d74d-4e48-a533-93d4e84db414 tempest-ProjectReaderTests-559441452 None] Created volume successfully. Nov 05 17:55:10 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:55:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-aaa516ac-869c-471d-893e-bb48039a7e40 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-48849f49-abfa-44a3-b921-b75157eaade5-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (f797192e-2940-4d7d-8b65-82aaf3710bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59402fa4-64cb-46e1-bef2-073abb886c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59402fa4-64cb-46e1-bef2-073abb886c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850055967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3fea69-0baa-49d0-ab94-cd9941ecd20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:11Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e396a4-38d3-4308-b29a-d82c480dbbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e396a4-38d3-4308-b29a-d82c480dbbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e38a2c5-6ac9-41f7-b427-2931b0627e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e38a2c5-6ac9-41f7-b427-2931b0627e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3fea69-0baa-49d0-ab94-cd9941ecd20b', 'volume_name': 'volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06700203-534b-46c0-a2cf-fce0af6a2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06700203-534b-46c0-a2cf-fce0af6a2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e7ac1b-d4a1-4d17-a89f-c5a976b5dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:11 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Volume 5f3fea69-0baa-49d0-ab94-cd9941ecd20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b', 'volume_size': 1} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850055967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3fea69-0baa-49d0-ab94-cd9941ecd20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:11Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Creating volume 5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:11 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:11 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b 1073741824 Nov 05 17:55:11 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Lock "cinder-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-quobyte-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9a03a-5972-43fc-834a-818ed07bb402]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:12 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 Nov 05 17:55:12 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:12 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b 1073741824" returned: 0 in 0.611s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:12 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b Nov 05 17:55:12 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:12 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88" returned: 0 in 0.471s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:12 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:12 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88 Nov 05 17:55:12 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e7ac1b-d4a1-4d17-a89f-c5a976b5dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b6fa40-72f7-42f5-9992-5503c32a75e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Volume volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b (5f3fea69-0baa-49d0-ab94-cd9941ecd20b): created successfully Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b6fa40-72f7-42f5-9992-5503c32a75e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (f797192e-2940-4d7d-8b65-82aaf3710bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-77aa2a93-b358-45f6-8516-c122a0f43b69 tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:55:12 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88" released by "delete_volume" :: held 0.788s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Created reservations ['b3901775-6bb9-4ae4-b37d-9020e9c0e9de', '751e0071-cd12-4cb2-a903-be2a9f28b752', 'a6390a16-0c6f-4910-b1fe-36a1200179e8', '90f2b5c2-6022-4b4e-ab82-623fe3266276'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:12 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:12 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:13 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.293s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Deleted volume successfully. Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66ce2871-6209-496d-b070-37c30e60c86b tempest-ProjectReaderTests-559441452 None] Lock "cinder-63efcee6-ee5d-44a6-8b3f-cf6ceb579c88-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (93d35ed7-0252-4cb8-a664-9b5292e47fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecf568f-bf40-4978-ac15-d8f82aeeb598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecf568f-bf40-4978-ac15-d8f82aeeb598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657790037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144e9044-d54c-45b1-aafa-00e27c05a219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:14Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f1f7ed-ed0b-47e6-b05f-3fbec1e24fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f1f7ed-ed0b-47e6-b05f-3fbec1e24fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5ea5be-0697-49b2-816d-b41897a5bd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5ea5be-0697-49b2-816d-b41897a5bd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144e9044-d54c-45b1-aafa-00e27c05a219', 'volume_name': 'volume-144e9044-d54c-45b1-aafa-00e27c05a219', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd59f564-6042-4052-bb9f-55116a54c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd59f564-6042-4052-bb9f-55116a54c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa6ce29-0769-4a0b-bace-db42459c2907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Volume 144e9044-d54c-45b1-aafa-00e27c05a219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144e9044-d54c-45b1-aafa-00e27c05a219', 'volume_size': 1} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657790037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144e9044-d54c-45b1-aafa-00e27c05a219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:14Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Creating volume 144e9044-d54c-45b1-aafa-00e27c05a219 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:13 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:13 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 1073741824 Nov 05 17:55:13 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:13 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:13 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:14 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.450s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:55:14 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 1073741824" returned: 0 in 0.672s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:14 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 Nov 05 17:55:14 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:14 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.891s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 of volume 5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa6ce29-0769-4a0b-bace-db42459c2907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144e9044-d54c-45b1-aafa-00e27c05a219', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056a9d00-b482-43eb-9419-982dc99a6862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3effafff-7690-4982-bccd-00f34118e7bb]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Flow 'volume_create_manager' (0210b5f3-2493-4d16-9acb-73e4dfab4142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83a16fa-ae23-42d3-90ee-e4543e371c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Volume volume-144e9044-d54c-45b1-aafa-00e27c05a219 (144e9044-d54c-45b1-aafa-00e27c05a219): created successfully Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056a9d00-b482-43eb-9419-982dc99a6862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (93d35ed7-0252-4cb8-a664-9b5292e47fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83a16fa-ae23-42d3-90ee-e4543e371c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-366016168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1767f18-833d-45fe-9e4f-b82c2fc32052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194a037fc9414b05b3308c7b0e01fc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:15Z,use_quota=True,user_id='9d2f1fe790264a799bf330fec3032f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71fb5b8-9c3d-40cf-a4a3-1908fcf61b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:15 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b Nov 05 17:55:15 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71fb5b8-9c3d-40cf-a4a3-1908fcf61b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346a17de-bcb8-424c-88e5-0564467f01ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346a17de-bcb8-424c-88e5-0564467f01ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1767f18-833d-45fe-9e4f-b82c2fc32052', 'volume_name': 'volume-e1767f18-833d-45fe-9e4f-b82c2fc32052', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ca7277-1426-42c2-8fe8-a162ca2b6d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ca7277-1426-42c2-8fe8-a162ca2b6d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc05c39c-d173-40b1-aa82-9c1a4ffc75ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Volume e1767f18-833d-45fe-9e4f-b82c2fc32052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1767f18-833d-45fe-9e4f-b82c2fc32052', 'volume_size': 1} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-03bafaf7-9944-4fc9-ae20-b0d64b131364 tempest-ProjectReaderTests-559441452 None] Created volume successfully. Nov 05 17:55:15 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:15 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 1G Nov 05 17:55:15 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:15 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 1G" returned: 0 in 0.382s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:15 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 Nov 05 17:55:15 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-144e9044-d54c-45b1-aafa-00e27c05a219-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Lock "cinder-144e9044-d54c-45b1-aafa-00e27c05a219-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-quobyte-144e9044-d54c-45b1-aafa-00e27c05a219" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-144e9044-d54c-45b1-aafa-00e27c05a219" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a51b42-bf23-4034-aabb-a29e8e13dadb]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:15 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:15 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 is being set with open permissions: ugo+rw Nov 05 17:55:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:15 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 Nov 05 17:55:15 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:16 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 Nov 05 17:55:16 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:16 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:16 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.info Nov 05 17:55:16 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:16 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219" returned: 0 in 0.382s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:16 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219 Nov 05 17:55:16 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:16 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.info" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:16 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.info is being set with open permissions: ugo+rw Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:16 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.info Nov 05 17:55:16 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:16 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-144e9044-d54c-45b1-aafa-00e27c05a219" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-144e9044-d54c-45b1-aafa-00e27c05a219" released by "delete_volume" :: held 0.693s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Created reservations ['665f1000-e17f-4582-b29d-b5623d35c4cd', 'fbda39d7-8c36-4706-a820-729c05b23250', 'afcf912f-8496-4934-a170-da145135e65c', '899029db-1a12-4896-9799-a5715ea5ef56'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:16 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:16 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:16 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.info" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-366016168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1767f18-833d-45fe-9e4f-b82c2fc32052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194a037fc9414b05b3308c7b0e01fc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:15Z,use_quota=True,user_id='9d2f1fe790264a799bf330fec3032f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Creating volume e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:16 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 1073741824 Nov 05 17:55:16 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-67ee0131-d70a-4903-9885-2efab76f30c3 tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:55:17 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Deleted volume successfully. Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bda3dda8-9f85-4f52-a37d-ba8b8c4f6a62 tempest-ProjectReaderTests-559441452 None] Lock "cinder-144e9044-d54c-45b1-aafa-00e27c05a219-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 of volume 5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5be3750-93c4-43ca-843f-538153092f48]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:17 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 Nov 05 17:55:17 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:17 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 1073741824" returned: 0 in 0.578s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:17 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 Nov 05 17:55:17 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (68fa8de0-9571-412c-8825-ff502696cedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23042ff0-7075-4a14-a009-7c3d98dd84c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23042ff0-7075-4a14-a009-7c3d98dd84c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603320920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4414190b-5497-47a4-a6fb-16b5455f7831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:17Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf25b4f-f1a0-436d-803f-734810a271a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf25b4f-f1a0-436d-803f-734810a271a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5497333-5118-4489-bcad-a1ed7d95887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5497333-5118-4489-bcad-a1ed7d95887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4414190b-5497-47a4-a6fb-16b5455f7831', 'volume_name': 'volume-4414190b-5497-47a4-a6fb-16b5455f7831', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e343c2eb-fe23-45af-98d1-623013314a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e343c2eb-fe23-45af-98d1-623013314a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3013c6d6-8c26-4b28-be79-f71b8fa97034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Volume 4414190b-5497-47a4-a6fb-16b5455f7831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4414190b-5497-47a4-a6fb-16b5455f7831', 'volume_size': 1} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:17 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df492a4-62bc-43f6-90d5-83073f142efa]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:17 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603320920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4414190b-5497-47a4-a6fb-16b5455f7831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621db412321742d6be69fe5a9b069a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:17Z,use_quota=True,user_id='d1ed7399cf684f1293c8e338ffd3f972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Creating volume 4414190b-5497-47a4-a6fb-16b5455f7831 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc05c39c-d173-40b1-aa82-9c1a4ffc75ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1767f18-833d-45fe-9e4f-b82c2fc32052', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:17 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 1073741824 Nov 05 17:55:17 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c8956d-1dbe-46fe-85b7-dbdf250adbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Volume volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 (e1767f18-833d-45fe-9e4f-b82c2fc32052): created successfully Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c8956d-1dbe-46fe-85b7-dbdf250adbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Flow 'volume_create_manager' (0210b5f3-2493-4d16-9acb-73e4dfab4142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:17 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b Nov 05 17:55:17 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cb036042-7bd0-4134-83c4-6fb46d4abb32 tempest-SnapshotDependencyTests-562314623 None] Created volume successfully. Nov 05 17:55:18 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" returned: 0 in 0.405s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:18 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 Nov 05 17:55:18 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:18 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 1073741824" returned: 0 in 0.524s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:18 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 Nov 05 17:55:18 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:18 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:18 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0 Nov 05 17:55:18 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:18 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.247s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Creating offline snapshot 0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 of volume e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3013c6d6-8c26-4b28-be79-f71b8fa97034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4414190b-5497-47a4-a6fb-16b5455f7831', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c75d69-e67a-4886-bca7-dcc9e92be1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ff5049-c1eb-496b-8d64-4a2f5d6b06fe]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Volume volume-4414190b-5497-47a4-a6fb-16b5455f7831 (4414190b-5497-47a4-a6fb-16b5455f7831): created successfully Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c75d69-e67a-4886-bca7-dcc9e92be1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Flow 'volume_create_manager' (68fa8de0-9571-412c-8825-ff502696cedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7e952c2b-9f77-4a0d-a9b1-33d08e676128 tempest-ProjectReaderTests-559441452 None] Created volume successfully. Nov 05 17:55:18 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 Nov 05 17:55:18 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:18 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b.eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0" released by "_delete_snapshot" :: held 1.682s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" released by "delete_snapshot" :: held 1.717s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Created reservations ['d8cb70fd-f53d-4bcc-9d8b-6eac4a463b29', 'a915fadc-9421-4ea7-9fbb-e11cff8dd5ff', 'c16abd33-88b1-4203-8572-f90f02beb3ca', '9f126efa-15eb-4119-8401-714529366d55'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:55:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0a7a57b1-8991-454c-9f26-6a684204c2a1 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-eb74bc24-7e30-49a0-9b4e-9c7da8fe54c0-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:19 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052" returned: 0 in 0.387s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:19 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 1G Nov 05 17:55:19 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-5f3fea69-0baa-49d0-ab94-cd9941ecd20b-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-5f3fea69-0baa-49d0-ab94-cd9941ecd20b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a9aaf6-3bbc-499a-86c3-321396031aa4]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:19 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 1G" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:19 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b Nov 05 17:55:19 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:19 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 Nov 05 17:55:19 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-4414190b-5497-47a4-a6fb-16b5455f7831-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Lock "cinder-4414190b-5497-47a4-a6fb-16b5455f7831-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Acquiring lock "cinder-quobyte-4414190b-5497-47a4-a6fb-16b5455f7831" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-4414190b-5497-47a4-a6fb-16b5455f7831" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884a6ba-0f1b-4888-beea-718240bd7047]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:19 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" returned: 0 in 0.449s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:19 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:19 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 is being set with open permissions: ugo+rw Nov 05 17:55:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:19 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b Nov 05 17:55:19 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:19 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 Nov 05 17:55:19 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:19 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 Nov 05 17:55:19 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:20 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:20 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5f3fea69-0baa-49d0-ab94-cd9941ecd20b" released by "delete_volume" :: held 0.825s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:20 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.info Nov 05 17:55:20 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:20 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831" returned: 0 in 0.427s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:20 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831 Nov 05 17:55:20 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Created reservations ['1628f7fe-9f98-4f6f-a0df-9854b678ec91', '7ca986e0-ee89-4f95-b03b-30c72c25b3e9', '754d5bfe-69fe-49f4-b187-1624076b4225', 'd8147583-bb5a-425a-9f00-b3cf8bcf554e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:20 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:20 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:20 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.info" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:20 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.info is being set with open permissions: ugo+rw Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:20 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.info Nov 05 17:55:20 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:20 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-4414190b-5497-47a4-a6fb-16b5455f7831" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Lock "cinder-quobyte-4414190b-5497-47a4-a6fb-16b5455f7831" released by "delete_volume" :: held 0.863s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:20 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-548bd9ac-c07b-43c5-9e57-5d69a8461748 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-5f3fea69-0baa-49d0-ab94-cd9941ecd20b-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Created reservations ['01737794-600f-4483-845a-c7dfcf00a3b2', '8aa302fd-5366-47e0-8c79-425792778ee3', '40ef0f55-7d57-48cd-ace3-830c2d33e918', 'dc46bbe2-86ed-4f3e-a534-a037ba5ab95a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:20 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.info" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:20 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:20 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-76c1e7aa-c97f-45d8-accb-e87b362adfea tempest-SnapshotDependencyTests-562314623 None] Create snapshot completed successfully Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (a63875ec-47f2-43af-8ee6-9f771b942315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791390de-78a6-4487-ab4e-4e229626168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791390de-78a6-4487-ab4e-4e229626168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749718337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63054db6-e2cc-476e-9afd-6c449140f527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:21Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f537d9b-7df0-4191-8447-1826424d6e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f537d9b-7df0-4191-8447-1826424d6e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86523444-e2a4-4ea4-bd91-b27a70083824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86523444-e2a4-4ea4-bd91-b27a70083824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63054db6-e2cc-476e-9afd-6c449140f527', 'volume_name': 'volume-63054db6-e2cc-476e-9afd-6c449140f527', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70370655-7619-4fa3-8368-cb481b199a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70370655-7619-4fa3-8368-cb481b199a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47183ff-0e35-4b5c-8310-07a81154673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Volume 63054db6-e2cc-476e-9afd-6c449140f527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63054db6-e2cc-476e-9afd-6c449140f527', 'volume_size': 1} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749718337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63054db6-e2cc-476e-9afd-6c449140f527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:21Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Creating volume 63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:21 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 1073741824 Nov 05 17:55:21 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:21 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.295s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Deleted volume successfully. Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5742141-bc99-4966-a014-da2d8b3ada7b tempest-ProjectReaderTests-559441452 None] Lock "cinder-4414190b-5497-47a4-a6fb-16b5455f7831-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:21 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 1073741824" returned: 0 in 0.524s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:21 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 Nov 05 17:55:21 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:22 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47183ff-0e35-4b5c-8310-07a81154673d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63054db6-e2cc-476e-9afd-6c449140f527', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c339f6-efbf-441e-ae3e-7ffd122ac55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Volume volume-63054db6-e2cc-476e-9afd-6c449140f527 (63054db6-e2cc-476e-9afd-6c449140f527): created successfully Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c339f6-efbf-441e-ae3e-7ffd122ac55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (a63875ec-47f2-43af-8ee6-9f771b942315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d599e01a-e67e-47ad-b41e-44ece141257f tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Flow 'volume_create_manager' (769ef907-f414-4cb6-a762-a25f040a2cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90b12f1-58b1-4f15-a1a9-18ddac0645d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90b12f1-58b1-4f15-a1a9-18ddac0645d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fea619-2ad6-4bbc-82b2-1e731b87430f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194a037fc9414b05b3308c7b0e01fc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:22Z,use_quota=True,user_id='9d2f1fe790264a799bf330fec3032f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d36557-bf99-4934-8b4f-dfc2c19acf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d36557-bf99-4934-8b4f-dfc2c19acf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c0538b-e024-4561-87d6-fd828f0e467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c0538b-e024-4561-87d6-fd828f0e467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90fea619-2ad6-4bbc-82b2-1e731b87430f', 'volume_name': 'volume-90fea619-2ad6-4bbc-82b2-1e731b87430f', 'volume_size': 1, 'snapshot_id': '0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad1493c-3206-4b26-a06e-f363f042437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad1493c-3206-4b26-a06e-f363f042437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e519a27e-2579-4225-afa1-ae4fc1096569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Volume 90fea619-2ad6-4bbc-82b2-1e731b87430f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90fea619-2ad6-4bbc-82b2-1e731b87430f', 'volume_size': 1, 'snapshot_id': '0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39'} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-quobyte-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39-90fea619-2ad6-4bbc-82b2-1e731b87430f" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39-90fea619-2ad6-4bbc-82b2-1e731b87430f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Creating volume 90fea619-2ad6-4bbc-82b2-1e731b87430f from snapshot 0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-quobyte-90fea619-2ad6-4bbc-82b2-1e731b87430f" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-90fea619-2ad6-4bbc-82b2-1e731b87430f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] snapshot: 0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39, volume: 90fea619-2ad6-4bbc-82b2-1e731b87430f, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e28bde-2af0-4ce9-b8b0-11a8ea996d9b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:22 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 Nov 05 17:55:22 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:22 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" returned: 0 in 0.437s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1767f18-833d-45fe-9e4f-b82c2fc32052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd46d120-8a6e-4fed-8159-04056eff0bda]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:23 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 Nov 05 17:55:23 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:23 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 17:55:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 17:55:23 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Path /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 17:55:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:23 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f Nov 05 17:55:23 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:29 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f" returned: 0 in 5.782s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Image conversion details: src /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 17:55:29 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Converted 1024.00 MB image at 177.08 MB/s Nov 05 17:55:29 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f is being set with open permissions: ugo+rw Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:29 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f Nov 05 17:55:29 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:29 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-90fea619-2ad6-4bbc-82b2-1e731b87430f" released by "_copy_volume_from_snapshot" :: held 6.942s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39-90fea619-2ad6-4bbc-82b2-1e731b87430f" released by "_create_volume_from_snapshot" :: held 7.007s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.026s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot 444532e9-96c7-47b0-a6ef-2660983c3fd7 of volume 63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e519a27e-2579-4225-afa1-ae4fc1096569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90fea619-2ad6-4bbc-82b2-1e731b87430f', 'volume_size': 1, 'snapshot_id': '0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff2ae07-5170-4ac6-aff5-7f7625721641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2779f08-8f91-41ac-82fe-83e448c89cbf]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Volume volume-90fea619-2ad6-4bbc-82b2-1e731b87430f (90fea619-2ad6-4bbc-82b2-1e731b87430f): created successfully Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff2ae07-5170-4ac6-aff5-7f7625721641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Flow 'volume_create_manager' (769ef907-f414-4cb6-a762-a25f040a2cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8f4f2f90-4c8e-4e06-ac5f-cf2ddaa26170 tempest-SnapshotDependencyTests-562314623 None] Created volume successfully. Nov 05 17:55:29 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 Nov 05 17:55:29 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:29 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:29 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 1G Nov 05 17:55:29 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-quobyte-e1767f18-833d-45fe-9e4f-b82c2fc32052" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-e1767f18-833d-45fe-9e4f-b82c2fc32052" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-quobyte-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Deleting offline snapshot 0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 of volume e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] snapshot_file for this snap is: volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a786e069-56f5-46cf-9a33-12e9583eb0f3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:30 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 Nov 05 17:55:30 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:30 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 1G" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63054db6-e2cc-476e-9afd-6c449140f527 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:30 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63054db6-e2cc-476e-9afd-6c449140f527 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 Nov 05 17:55:30 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:30 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" returned: 0 in 0.371s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1767f18-833d-45fe-9e4f-b82c2fc32052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dede4ae6-4255-4f62-a13f-1e6c348fae6d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:30 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 Nov 05 17:55:30 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:30 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63054db6-e2cc-476e-9afd-6c449140f527 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:30 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 is being set with open permissions: ugo+rw Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:30 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 Nov 05 17:55:30 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:30 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:30 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.info Nov 05 17:55:30 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:30 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052" returned: 0 in 0.517s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:30 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 Nov 05 17:55:30 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:30 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.info" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:30 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.info is being set with open permissions: ugo+rw Nov 05 17:55:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:31 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.info Nov 05 17:55:31 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:31 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:31 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39 Nov 05 17:55:31 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:31 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.info" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c8beb213-e9de-4b4c-a49c-2948a91ebe5a tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:55:31 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052.0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" returned: 0 in 0.232s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39" released by "_delete_snapshot" :: held 1.551s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-e1767f18-833d-45fe-9e4f-b82c2fc32052" released by "delete_snapshot" :: held 1.576s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Created reservations ['5bbf6780-69ca-4636-a57c-79b29b4ac71d', '65eec5c7-5f9d-4942-9b3d-b85f33adbdbd', '50bb7d9e-4cd4-4efe-bc8d-dcb05e3b3193', '69900710-f584-4f58-862d-a0a0056958cb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Delete snapshot completed successfully. Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dcc95e4a-9d4f-48ad-b969-d9c10c57097a tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-0bd7fa4e-8bae-4d21-ac98-a4ec48c75f39-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-444532e9-96c7-47b0-a6ef-2660983c3fd7-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-444532e9-96c7-47b0-a6ef-2660983c3fd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-63054db6-e2cc-476e-9afd-6c449140f527" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-63054db6-e2cc-476e-9afd-6c449140f527" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-444532e9-96c7-47b0-a6ef-2660983c3fd7" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-444532e9-96c7-47b0-a6ef-2660983c3fd7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot 444532e9-96c7-47b0-a6ef-2660983c3fd7 of volume 63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd75f553-4c91-4afa-b5d5-90dc7d6fcc3b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:31 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 Nov 05 17:55:31 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-e1767f18-833d-45fe-9e4f-b82c2fc32052-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-e1767f18-833d-45fe-9e4f-b82c2fc32052-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-quobyte-e1767f18-833d-45fe-9e4f-b82c2fc32052" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-e1767f18-833d-45fe-9e4f-b82c2fc32052" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca5cad9-960f-498c-b9fc-0643f9dd1558]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:32 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63054db6-e2cc-476e-9afd-6c449140f527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a4eea1-9d68-4572-b533-7383c8a6559c]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:32 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 Nov 05 17:55:32 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:32 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 Nov 05 17:55:32 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:32 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:32 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052 Nov 05 17:55:32 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:32 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:32 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 Nov 05 17:55:32 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:32 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-e1767f18-833d-45fe-9e4f-b82c2fc32052" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-e1767f18-833d-45fe-9e4f-b82c2fc32052" released by "delete_volume" :: held 0.657s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Created reservations ['e0016938-41c4-4ee4-a87c-08d47091e012', '2f51a151-090e-47c6-973e-7e7724cf1cf5', '5a4b84bb-b118-4e82-afbc-e43a45c3af6c', 'd662730d-0f0c-4040-a455-74005811f9ea'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:32 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:32 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:32 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:32 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7 Nov 05 17:55:32 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:33 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:33 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527.444532e9-96c7-47b0-a6ef-2660983c3fd7" returned: 0 in 0.237s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Deleted volume successfully. Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-444532e9-96c7-47b0-a6ef-2660983c3fd7" released by "_delete_snapshot" :: held 1.404s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-63054db6-e2cc-476e-9afd-6c449140f527" released by "delete_snapshot" :: held 1.431s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ff7d5dcc-45f9-4f30-8643-8619d330fa14 tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-e1767f18-833d-45fe-9e4f-b82c2fc32052-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-90fea619-2ad6-4bbc-82b2-1e731b87430f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-90fea619-2ad6-4bbc-82b2-1e731b87430f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "cinder-quobyte-90fea619-2ad6-4bbc-82b2-1e731b87430f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Created reservations ['f28c33c1-ef38-484f-bd5f-f99cedeea376', '4f6e4d6a-4315-43ee-a5f5-07b684a128a2', '0fd381d1-4e91-43c8-82a2-9eb164184a22', 'ab47be1a-321d-4a5f-8df8-07e8e47f02a3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-90fea619-2ad6-4bbc-82b2-1e731b87430f" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e61a2-af71-4936-870e-4576bd2a0b44]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a0706bb0-787c-4169-98e3-5263be2a640a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-444532e9-96c7-47b0-a6ef-2660983c3fd7-delete_snapshot" released by "delete_snapshot" :: held 1.617s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:33 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f Nov 05 17:55:33 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:33 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:33 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f Nov 05 17:55:33 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-63054db6-e2cc-476e-9afd-6c449140f527-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-63054db6-e2cc-476e-9afd-6c449140f527-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:33 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-90fea619-2ad6-4bbc-82b2-1e731b87430f" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-quobyte-90fea619-2ad6-4bbc-82b2-1e731b87430f" released by "delete_volume" :: held 0.631s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-63054db6-e2cc-476e-9afd-6c449140f527" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-63054db6-e2cc-476e-9afd-6c449140f527" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Created reservations ['b6ecb5ac-1c80-424e-8918-31944f8a6f80', '4269edc5-4fa0-4a9e-a1dc-80ac648178f5', '08a3f28a-c592-4785-a140-4f79bab3c8b2', '81c0edf5-6bcb-4fa2-b4ac-108e3496d76b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa968e8-d724-4c30-8e40-9a1175993272]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:34 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:34 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:34 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 Nov 05 17:55:34 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:34 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Deleted volume successfully. Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1927a3ad-a5ca-4f5f-83d4-1d74929e3a7c tempest-SnapshotDependencyTests-562314623 None] Lock "cinder-90fea619-2ad6-4bbc-82b2-1e731b87430f-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:34 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527" returned: 0 in 0.382s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:34 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527 Nov 05 17:55:34 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:34 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-63054db6-e2cc-476e-9afd-6c449140f527" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-63054db6-e2cc-476e-9afd-6c449140f527" released by "delete_volume" :: held 0.707s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Created reservations ['87384e4f-2689-4f32-a224-c20cb42aa4a4', 'a9fa83f9-6224-40da-a1b4-85d51a472960', '710b7e5e-6373-4636-ac5b-4f9443d7c53b', '4cf296fa-3ff1-4715-9e9e-2d4d1904034b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:34 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:34 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:35 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6468bb06-9b25-48fb-a0c8-36a07843ea95 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-63054db6-e2cc-476e-9afd-6c449140f527-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (2f2da9e3-c863-47ea-84e9-67684e2281c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd12ed01-d163-415f-a0ae-313e825e5d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd12ed01-d163-415f-a0ae-313e825e5d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324042694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da75c71-1bf2-4c2f-af42-c693d87621f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:35Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab47537-4b59-4db5-94ee-ff0c8b791450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab47537-4b59-4db5-94ee-ff0c8b791450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f444408-41f8-478d-9333-75dd6942302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f444408-41f8-478d-9333-75dd6942302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da75c71-1bf2-4c2f-af42-c693d87621f8', 'volume_name': 'volume-5da75c71-1bf2-4c2f-af42-c693d87621f8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15eaea5-746b-4b56-b10e-9fa7772680b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15eaea5-746b-4b56-b10e-9fa7772680b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205b2fd6-7f14-4a8e-927b-600a37fc6efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Volume 5da75c71-1bf2-4c2f-af42-c693d87621f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da75c71-1bf2-4c2f-af42-c693d87621f8', 'volume_size': 1} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324042694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da75c71-1bf2-4c2f-af42-c693d87621f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:35Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Creating volume 5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:35 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 1073741824 Nov 05 17:55:35 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:36 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 1073741824" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:36 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 Nov 05 17:55:36 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:36 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205b2fd6-7f14-4a8e-927b-600a37fc6efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da75c71-1bf2-4c2f-af42-c693d87621f8', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eda266-e423-45d9-9ef5-bddc9bd1aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Volume volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 (5da75c71-1bf2-4c2f-af42-c693d87621f8): created successfully Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eda266-e423-45d9-9ef5-bddc9bd1aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (2f2da9e3-c863-47ea-84e9-67684e2281c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d3ff8a18-18e7-411c-8cad-e88d4c833151 tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot 1a00bbf9-3a3f-43f0-91dd-f4af29194503 of volume 5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ef5fd0-9fba-4704-809c-81a3f7e40dd6]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:36 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 Nov 05 17:55:36 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:37 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8" returned: 0 in 0.390s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:37 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 1G Nov 05 17:55:37 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:37 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 1G" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:37 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 Nov 05 17:55:37 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:37 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:37 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 is being set with open permissions: ugo+rw Nov 05 17:55:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:37 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 Nov 05 17:55:37 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:38 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:38 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.info Nov 05 17:55:38 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:38 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.info" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:38 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.info is being set with open permissions: ugo+rw Nov 05 17:55:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:38 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.info Nov 05 17:55:38 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:38 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.info" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7d77005a-9a2f-4b70-b9ad-dd73c5759e9f tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:55:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-1a00bbf9-3a3f-43f0-91dd-f4af29194503-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-1a00bbf9-3a3f-43f0-91dd-f4af29194503-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-5da75c71-1bf2-4c2f-af42-c693d87621f8" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5da75c71-1bf2-4c2f-af42-c693d87621f8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-1a00bbf9-3a3f-43f0-91dd-f4af29194503" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-1a00bbf9-3a3f-43f0-91dd-f4af29194503" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot 1a00bbf9-3a3f-43f0-91dd-f4af29194503 of volume 5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[694910b0-6a8d-4bcc-b45d-acb42cd7bee5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:40 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 Nov 05 17:55:40 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:40 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da75c71-1bf2-4c2f-af42-c693d87621f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e186c3c6-c982-42e6-9b8a-7ae183eab7f5]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:40 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 Nov 05 17:55:40 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:40 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:40 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 Nov 05 17:55:40 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:41 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:41 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503 Nov 05 17:55:41 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:41 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8.1a00bbf9-3a3f-43f0-91dd-f4af29194503" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-1a00bbf9-3a3f-43f0-91dd-f4af29194503" released by "_delete_snapshot" :: held 1.509s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5da75c71-1bf2-4c2f-af42-c693d87621f8" released by "delete_snapshot" :: held 1.533s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:41 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Created reservations ['02aeee46-cdec-4f55-835f-a3ae437a377e', '6bf9b72b-0f19-404e-980f-4fdcbacb4201', '3af5b1a2-95bf-4ae1-ad9f-5559660eac71', '36f1d9e8-c73c-4632-adf7-7d3904990fcf'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:55:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1d6b067c-6365-444a-af0a-a1efae47d424 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-1a00bbf9-3a3f-43f0-91dd-f4af29194503-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-5da75c71-1bf2-4c2f-af42-c693d87621f8-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-5da75c71-1bf2-4c2f-af42-c693d87621f8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-5da75c71-1bf2-4c2f-af42-c693d87621f8" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5da75c71-1bf2-4c2f-af42-c693d87621f8" acquired by "delete_volume" :: waited 0.012s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0620cc6-58c2-42dd-bdf0-1ef9864a2717]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:42 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 Nov 05 17:55:42 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:42 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:42 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8 Nov 05 17:55:42 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:42 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-5da75c71-1bf2-4c2f-af42-c693d87621f8" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-5da75c71-1bf2-4c2f-af42-c693d87621f8" released by "delete_volume" :: held 0.730s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Created reservations ['626e9301-9842-4e36-b5bc-a51a386a6ac2', 'e52f5c6a-c9ab-4163-a858-3ac1f474f0de', '8a9e0772-a3b6-4e22-bd04-7233891b41d1', 'bceaf861-5d9b-4dd4-b224-9bfdcb0938ee'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:43 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:43 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:43 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-50de0c4e-695a-40a1-bb13-0f8aa5f6e469 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-5da75c71-1bf2-4c2f-af42-c693d87621f8-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (32b58265-af8c-44ee-ad72-aeb2adf6bb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776ec88b-4129-4003-9209-ea7485ff4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776ec88b-4129-4003-9209-ea7485ff4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930813137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc42635e-183f-42af-a0db-fd58a6b8f3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:44Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21de49e5-a204-41a8-a402-b539f7fa21da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21de49e5-a204-41a8-a402-b539f7fa21da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55f6d1c-cfd3-47c0-ade4-d007c8493f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55f6d1c-cfd3-47c0-ade4-d007c8493f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc42635e-183f-42af-a0db-fd58a6b8f3df', 'volume_name': 'volume-cc42635e-183f-42af-a0db-fd58a6b8f3df', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01d323a-1658-4a28-9a98-12a76d194316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01d323a-1658-4a28-9a98-12a76d194316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdec10c-ba23-4940-9418-cdb5c8a04b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Volume cc42635e-183f-42af-a0db-fd58a6b8f3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc42635e-183f-42af-a0db-fd58a6b8f3df', 'volume_size': 1} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930813137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc42635e-183f-42af-a0db-fd58a6b8f3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:44Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Creating volume cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:43 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:43 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df 1073741824 Nov 05 17:55:43 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:44 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df 1073741824" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:44 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df Nov 05 17:55:44 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:44 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdec10c-ba23-4940-9418-cdb5c8a04b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc42635e-183f-42af-a0db-fd58a6b8f3df', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0883ce5c-658c-4199-b610-6127912a348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Volume volume-cc42635e-183f-42af-a0db-fd58a6b8f3df (cc42635e-183f-42af-a0db-fd58a6b8f3df): created successfully Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0883ce5c-658c-4199-b610-6127912a348a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (32b58265-af8c-44ee-ad72-aeb2adf6bb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa31a58e-5736-4da1-ac5e-11c1a24ae1f0 tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot 2c8276c5-a191-4b43-b835-b41ad894c8d0 of volume cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d7b124-c176-499f-9796-9757a8e60995]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:46 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df Nov 05 17:55:46 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:46 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:46 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 1G Nov 05 17:55:46 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:46 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 1G" returned: 0 in 0.441s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc42635e-183f-42af-a0db-fd58a6b8f3df -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:46 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc42635e-183f-42af-a0db-fd58a6b8f3df -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 Nov 05 17:55:46 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:47 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc42635e-183f-42af-a0db-fd58a6b8f3df -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:47 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 is being set with open permissions: ugo+rw Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:47 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 Nov 05 17:55:47 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:47 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:47 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.info Nov 05 17:55:47 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:47 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.info" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:47 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.info is being set with open permissions: ugo+rw Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:47 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.info Nov 05 17:55:47 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:47 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.info" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-993a579c-489e-4a79-91bd-588d2851c1fc tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-2c8276c5-a191-4b43-b835-b41ad894c8d0-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2c8276c5-a191-4b43-b835-b41ad894c8d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-cc42635e-183f-42af-a0db-fd58a6b8f3df" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-cc42635e-183f-42af-a0db-fd58a6b8f3df" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-2c8276c5-a191-4b43-b835-b41ad894c8d0" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2c8276c5-a191-4b43-b835-b41ad894c8d0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot 2c8276c5-a191-4b43-b835-b41ad894c8d0 of volume cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e208be4d-b4df-4980-ba08-209c20de125d]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:48 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 Nov 05 17:55:48 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:48 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc42635e-183f-42af-a0db-fd58a6b8f3df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c1e8d0-9adc-400b-bf88-760b0f51a844]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:48 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df Nov 05 17:55:48 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:48 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:49 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 Nov 05 17:55:49 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:49 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:49 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0 Nov 05 17:55:49 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:49 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df.2c8276c5-a191-4b43-b835-b41ad894c8d0" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2c8276c5-a191-4b43-b835-b41ad894c8d0" released by "_delete_snapshot" :: held 1.359s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-cc42635e-183f-42af-a0db-fd58a6b8f3df" released by "delete_snapshot" :: held 1.379s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:49 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Created reservations ['6a3e75f9-fc9c-487c-8d1c-0b28017b9049', '21a511b0-e4ae-4db7-bb48-d26c5121c396', '2976b7b0-257e-4f49-abf1-1ee8288f2082', '68a63d74-e357-4040-8699-35c61eea5b11'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:55:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3572099c-4133-471e-a15f-f616e323f898 tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2c8276c5-a191-4b43-b835-b41ad894c8d0-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-cc42635e-183f-42af-a0db-fd58a6b8f3df-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Lock "cinder-cc42635e-183f-42af-a0db-fd58a6b8f3df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-cc42635e-183f-42af-a0db-fd58a6b8f3df" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-cc42635e-183f-42af-a0db-fd58a6b8f3df" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c08564e-391f-443d-b300-f2c343aeba17]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:50 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df Nov 05 17:55:50 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:50 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:50 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df Nov 05 17:55:50 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:51 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-cc42635e-183f-42af-a0db-fd58a6b8f3df" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-cc42635e-183f-42af-a0db-fd58a6b8f3df" released by "delete_volume" :: held 0.682s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=145,cinder:INSERT=47,cinder:UPDATE=199,cinder:DELETE=17 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Created reservations ['5e68c632-ec92-4d59-91b6-7375cc04a432', '80faf181-936a-4402-93a7-aa6a0c807eaf', 'fddaabe4-f12b-4281-8d12-e4a09babadf3', '2259b9de-6ed9-4307-a26a-8507bcb67b94'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:51 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:51 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:51 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=197,cinder:SELECT=152,cinder:INSERT=56,cinder:DELETE=18 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7508c19a-72c7-4a19-b2b7-0fe83b3fdd5d tempest-ProjectMemberTests-1523020904 None] Lock "cinder-cc42635e-183f-42af-a0db-fd58a6b8f3df-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:51 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (6a37078e-8f66-45b3-a914-e83fb1e91450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85992bf-cd55-4d55-8dbd-61ea0237ce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85992bf-cd55-4d55-8dbd-61ea0237ce03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349046459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c5ac5-327a-4209-86f0-9f489af84a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:52Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2200fd32-2a70-459e-bdbe-8e6cca2cfb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2200fd32-2a70-459e-bdbe-8e6cca2cfb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0e4026-c7be-4cec-9f60-afaa2a5d1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0e4026-c7be-4cec-9f60-afaa2a5d1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5c5ac5-327a-4209-86f0-9f489af84a3c', 'volume_name': 'volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edc9d81-0699-4c69-8c51-1204fd8ac510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edc9d81-0699-4c69-8c51-1204fd8ac510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287fa503-3376-49fe-8de3-3bbaa084d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Volume 3d5c5ac5-327a-4209-86f0-9f489af84a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c', 'volume_size': 1} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349046459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c5ac5-327a-4209-86f0-9f489af84a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5281748ea59948a29e3f212138911a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:55:52Z,use_quota=True,user_id='e03624cf714d418a9aee7cc8b54b6743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Creating volume 3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:55:52 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:52 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c 1073741824 Nov 05 17:55:52 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:52 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c 1073741824" returned: 0 in 0.426s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:52 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c Nov 05 17:55:52 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:52 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287fa503-3376-49fe-8de3-3bbaa084d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5730f5e7-a0a0-41f6-a0d3-9056430128f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:55:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Volume volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c (3d5c5ac5-327a-4209-86f0-9f489af84a3c): created successfully Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5730f5e7-a0a0-41f6-a0d3-9056430128f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:55:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Flow 'volume_create_manager' (6a37078e-8f66-45b3-a914-e83fb1e91450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:55:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0b662306-5a0e-4c02-af88-dfa4b1f89e09 tempest-ProjectMemberTests-1523020904 None] Created volume successfully. Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Creating offline snapshot 2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 of volume 3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a620340f-8081-40e0-a883-4f317bff0673]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:53 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c Nov 05 17:55:53 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:53 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:53 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 1G Nov 05 17:55:53 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:53 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 1G" returned: 0 in 0.382s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:53 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 Nov 05 17:55:53 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:54 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:54 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 is being set with open permissions: ugo+rw Nov 05 17:55:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:54 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 Nov 05 17:55:54 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:54 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:54 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.info Nov 05 17:55:54 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:54 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.info" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:54 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.info is being set with open permissions: ugo+rw Nov 05 17:55:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:54 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.info Nov 05 17:55:54 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:54 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.info" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-33beb534-3890-4da8-b2bd-63bd89028fe9 tempest-ProjectMemberTests-1523020904 None] Create snapshot completed successfully Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-2d6c5f63-35e7-4cae-9ed0-42eefaf168b9-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2d6c5f63-35e7-4cae-9ed0-42eefaf168b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-3d5c5ac5-327a-4209-86f0-9f489af84a3c" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-3d5c5ac5-327a-4209-86f0-9f489af84a3c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Deleting offline snapshot 2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 of volume 3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] snapshot_file for this snap is: volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b707a2e-f00d-4f43-aea7-0564254a6fa7]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:55 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 Nov 05 17:55:55 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:55 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3b7c8b-d127-4a4d-80b0-9bb6ad367a53]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:55 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c Nov 05 17:55:55 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:56 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:56 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 Nov 05 17:55:56 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:56 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:56 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9 Nov 05 17:55:56 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:56 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c.2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-2d6c5f63-35e7-4cae-9ed0-42eefaf168b9" released by "_delete_snapshot" :: held 1.388s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-3d5c5ac5-327a-4209-86f0-9f489af84a3c" released by "delete_snapshot" :: held 1.412s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Created reservations ['00b29b58-10e0-401f-99aa-65a078ad8aa6', '0a1a2337-f79b-4ce2-8d6b-cdf6e9bca4e9', '1b179842-6dbb-4170-82bf-c4e902527171', '8fcb96a5-5d04-4a61-9159-1723ab747bed'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Delete snapshot completed successfully. Nov 05 17:55:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-48c7a718-39c0-4634-b8fa-5337db1a145a tempest-ProjectMemberTests-1523020904 None] Lock "cinder-2d6c5f63-35e7-4cae-9ed0-42eefaf168b9-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-3d5c5ac5-327a-4209-86f0-9f489af84a3c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Lock "cinder-3d5c5ac5-327a-4209-86f0-9f489af84a3c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Acquiring lock "cinder-quobyte-3d5c5ac5-327a-4209-86f0-9f489af84a3c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:55:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-3d5c5ac5-327a-4209-86f0-9f489af84a3c" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:55:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c16b9c8-549c-46db-b5ee-5468a08f3f70]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:55:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:57 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c Nov 05 17:55:57 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:58 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:58 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c Nov 05 17:55:58 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:58 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-3d5c5ac5-327a-4209-86f0-9f489af84a3c" returned: 0 in 0.229s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Lock "cinder-quobyte-3d5c5ac5-327a-4209-86f0-9f489af84a3c" released by "delete_volume" :: held 0.676s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Created reservations ['66725fa5-fc38-49a6-9e9d-b6fdd7fe1e4e', 'fc47de5b-854e-44d7-b7d9-9b3225a9cbbe', '54ab5c09-ad9c-4777-ae33-d677d3f2bda4', 'ccd9589e-932c-476a-b4ca-24eb2765adeb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:55:58 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:55:58 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:55:58 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.230s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:55:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Deleted volume successfully. Nov 05 17:55:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1d43a97-b4c8-49c3-a7dd-dff24eb2e99c tempest-ProjectMemberTests-1523020904 None] Lock "cinder-3d5c5ac5-327a-4209-86f0-9f489af84a3c-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:56:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (20bf8735-b379-41ca-b789-2707584a28d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a802657-3e7a-4d19-8f14-0a5d487916d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a802657-3e7a-4d19-8f14-0a5d487916d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125155366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bec084-acf4-4c78-82a7-e996341ccb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:02Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b8f098-277b-418c-bd81-5d70a82207d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b8f098-277b-418c-bd81-5d70a82207d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c14df2-d046-48b5-8a3c-558d05bd89dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c14df2-d046-48b5-8a3c-558d05bd89dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6bec084-acf4-4c78-82a7-e996341ccb82', 'volume_name': 'volume-b6bec084-acf4-4c78-82a7-e996341ccb82', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42d2192-21a8-49d6-ae83-46f659d762d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42d2192-21a8-49d6-ae83-46f659d762d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee993a6-e83c-47e0-a428-81c4767da3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Volume b6bec084-acf4-4c78-82a7-e996341ccb82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6bec084-acf4-4c78-82a7-e996341ccb82', 'volume_size': 1} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125155366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bec084-acf4-4c78-82a7-e996341ccb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:02Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Creating volume b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:56:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:02 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 1073741824 Nov 05 17:56:02 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:02 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 1073741824" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:02 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 Nov 05 17:56:02 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:02 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82" returned: 0 in 0.229s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] <== create_volume: return (652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee993a6-e83c-47e0-a428-81c4767da3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bec084-acf4-4c78-82a7-e996341ccb82', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c130a326-8977-410f-bedb-4afefe86b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Volume volume-b6bec084-acf4-4c78-82a7-e996341ccb82 (b6bec084-acf4-4c78-82a7-e996341ccb82): created successfully Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c130a326-8977-410f-bedb-4afefe86b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (20bf8735-b379-41ca-b789-2707584a28d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f14b8a88-f96e-4d65-8b1c-3ffe9cf84bda tempest-ProjectReaderTests-518711231 None] Created volume successfully. Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Creating offline snapshot 3b25cb17-2a81-4e65-a4e8-e16def86ba4d of volume b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a4903d-6e0d-44cf-956c-f2a09ddb807f]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:03 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 Nov 05 17:56:03 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:03 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:03 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d 1G Nov 05 17:56:03 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:03 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d 1G" returned: 0 in 0.378s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6bec084-acf4-4c78-82a7-e996341ccb82 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:03 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6bec084-acf4-4c78-82a7-e996341ccb82 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d Nov 05 17:56:03 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:04 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6bec084-acf4-4c78-82a7-e996341ccb82 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:04 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d is being set with open permissions: ugo+rw Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:04 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d Nov 05 17:56:04 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:04 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d" returned: 0 in 0.231s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:04 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.info Nov 05 17:56:04 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:04 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.info" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:04 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.info is being set with open permissions: ugo+rw Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:04 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.info Nov 05 17:56:04 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:04 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.info" returned: 0 in 0.229s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.754s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9c6ced4e-35b7-42b4-a148-1d779fc66d73 tempest-ProjectReaderTests-518711231 None] Create snapshot completed successfully Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-3b25cb17-2a81-4e65-a4e8-e16def86ba4d-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Lock "cinder-3b25cb17-2a81-4e65-a4e8-e16def86ba4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-b6bec084-acf4-4c78-82a7-e996341ccb82" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-b6bec084-acf4-4c78-82a7-e996341ccb82" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-3b25cb17-2a81-4e65-a4e8-e16def86ba4d" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-3b25cb17-2a81-4e65-a4e8-e16def86ba4d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Deleting offline snapshot 3b25cb17-2a81-4e65-a4e8-e16def86ba4d of volume b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] snapshot_file for this snap is: volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9361d10-4da8-4ec8-aca8-6ee519020b43]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:05 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d Nov 05 17:56:05 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:05 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6bec084-acf4-4c78-82a7-e996341ccb82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cddd50a-f4fa-4b02-ae69-2db307ddfd3a]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:05 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 Nov 05 17:56:05 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:06 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82" returned: 0 in 0.342s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:06 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d Nov 05 17:56:06 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:06 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:06 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d Nov 05 17:56:06 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:06 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82.3b25cb17-2a81-4e65-a4e8-e16def86ba4d" returned: 0 in 0.228s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-3b25cb17-2a81-4e65-a4e8-e16def86ba4d" released by "_delete_snapshot" :: held 1.315s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-b6bec084-acf4-4c78-82a7-e996341ccb82" released by "delete_snapshot" :: held 1.334s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Created reservations ['2d20d5b1-8f75-484e-a40b-b6c4a74d2c8c', '7ea9b0f7-b2f7-4217-8b0b-68db5a943ff8', '7236c22e-4517-475a-9d97-3d5c0b586f34', 'ccec2144-a286-41c8-9d76-c69cee75af31'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Delete snapshot completed successfully. Nov 05 17:56:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ddfbc215-1388-415a-bfaf-d1501b9bf6b5 tempest-ProjectReaderTests-518711231 None] Lock "cinder-3b25cb17-2a81-4e65-a4e8-e16def86ba4d-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-b6bec084-acf4-4c78-82a7-e996341ccb82-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Lock "cinder-b6bec084-acf4-4c78-82a7-e996341ccb82-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-b6bec084-acf4-4c78-82a7-e996341ccb82" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-b6bec084-acf4-4c78-82a7-e996341ccb82" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f965ddf-8b5c-42d4-809d-93b205c34aae]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:07 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 Nov 05 17:56:07 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:07 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:07 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82 Nov 05 17:56:07 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:08 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-b6bec084-acf4-4c78-82a7-e996341ccb82" returned: 0 in 0.230s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-b6bec084-acf4-4c78-82a7-e996341ccb82" released by "delete_volume" :: held 0.636s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Created reservations ['6aad1c0b-50bb-4562-b812-f0e5f9a5086d', '34062c7c-f0fd-4677-bc57-4d86219e4d72', '51e8915d-2dbd-4c5c-93d6-e624ea45c3ba', '3bbc8fb5-ea9a-4a02-bb25-b3876ca5f05b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:08 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:56:08 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:08 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.224s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:56:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Deleted volume successfully. Nov 05 17:56:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d696a5ef-c9c8-42b7-b2ac-6c74f9163085 tempest-ProjectReaderTests-518711231 None] Lock "cinder-b6bec084-acf4-4c78-82a7-e996341ccb82-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (ea2c009e-41cb-4fbf-b194-83ea66fb7c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96299b2e-9bac-4e84-bf11-2d93c68f3a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96299b2e-9bac-4e84-bf11-2d93c68f3a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182847723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694dc0b3-a81b-4c4c-b494-a5243898ba65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:09Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51136eb-8b7d-4a6f-858c-f5500dbca7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51136eb-8b7d-4a6f-858c-f5500dbca7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faebe334-9553-4848-8827-83e87d638f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faebe334-9553-4848-8827-83e87d638f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694dc0b3-a81b-4c4c-b494-a5243898ba65', 'volume_name': 'volume-694dc0b3-a81b-4c4c-b494-a5243898ba65', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac815cd0-cbc2-4b9c-97b1-aeff1b5c6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac815cd0-cbc2-4b9c-97b1-aeff1b5c6b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e9c4b-8352-4124-882f-816af0997e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Volume 694dc0b3-a81b-4c4c-b494-a5243898ba65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694dc0b3-a81b-4c4c-b494-a5243898ba65', 'volume_size': 1} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182847723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694dc0b3-a81b-4c4c-b494-a5243898ba65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:09Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Creating volume 694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:56:09 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:09 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 1073741824 Nov 05 17:56:09 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:09 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 1073741824" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:09 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 Nov 05 17:56:09 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:09 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] <== create_volume: return (651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e9c4b-8352-4124-882f-816af0997e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694dc0b3-a81b-4c4c-b494-a5243898ba65', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a048af35-4e59-4a3e-a0f4-67bd3238dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Volume volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 (694dc0b3-a81b-4c4c-b494-a5243898ba65): created successfully Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a048af35-4e59-4a3e-a0f4-67bd3238dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (ea2c009e-41cb-4fbf-b194-83ea66fb7c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-81a72534-bfa2-4d52-b2a7-fc564f34b51a tempest-ProjectReaderTests-518711231 None] Created volume successfully. Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Creating offline snapshot 2cd808bf-d949-4c06-8290-332103d3b989 of volume 694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fcec4f-f4de-4216-accc-733d38d12e02]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:10 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 Nov 05 17:56:10 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:10 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65" returned: 0 in 0.342s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:10 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 1G Nov 05 17:56:10 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:10 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 1G" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:10 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 Nov 05 17:56:10 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:11 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989" returned: 0 in 0.281s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:11 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 is being set with open permissions: ugo+rw Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:11 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 Nov 05 17:56:11 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:11 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989" returned: 0 in 0.234s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:11 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.info Nov 05 17:56:11 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:11 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.info" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:11 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.info is being set with open permissions: ugo+rw Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:11 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.info Nov 05 17:56:11 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:11 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.info" returned: 0 in 0.225s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-45bf4346-a755-437c-b254-79580be6fe96 tempest-ProjectReaderTests-518711231 None] Create snapshot completed successfully Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-2cd808bf-d949-4c06-8290-332103d3b989-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Lock "cinder-2cd808bf-d949-4c06-8290-332103d3b989-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-694dc0b3-a81b-4c4c-b494-a5243898ba65" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-694dc0b3-a81b-4c4c-b494-a5243898ba65" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-2cd808bf-d949-4c06-8290-332103d3b989" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-2cd808bf-d949-4c06-8290-332103d3b989" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Deleting offline snapshot 2cd808bf-d949-4c06-8290-332103d3b989 of volume 694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] snapshot_file for this snap is: volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7737ab-0468-44bd-9e6f-fc5470816ce8]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:12 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 Nov 05 17:56:12 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:12 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694dc0b3-a81b-4c4c-b494-a5243898ba65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a46977e-97fc-4d98-9529-e0c8d53338a9]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:12 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 Nov 05 17:56:12 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:13 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65" returned: 0 in 0.342s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:13 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 Nov 05 17:56:13 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:13 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989" returned: 0 in 0.316s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:13 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989 Nov 05 17:56:13 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:13 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65.2cd808bf-d949-4c06-8290-332103d3b989" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-2cd808bf-d949-4c06-8290-332103d3b989" released by "_delete_snapshot" :: held 1.333s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-694dc0b3-a81b-4c4c-b494-a5243898ba65" released by "delete_snapshot" :: held 1.353s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Created reservations ['ebc153ce-451d-4012-9e7a-d8fc40827033', 'fd249555-24af-4cc5-ac82-6c9e924a7728', '0d702df1-2f13-42b3-a739-b25e366f1435', '2db85d20-c382-483b-b744-c91c1d281af6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Delete snapshot completed successfully. Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e60cef8-4a9d-41d7-8571-bacd2de069dc tempest-ProjectReaderTests-518711231 None] Lock "cinder-2cd808bf-d949-4c06-8290-332103d3b989-delete_snapshot" released by "delete_snapshot" :: held 1.483s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:13 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:56:13 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:14 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-694dc0b3-a81b-4c4c-b494-a5243898ba65-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Lock "cinder-694dc0b3-a81b-4c4c-b494-a5243898ba65-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-694dc0b3-a81b-4c4c-b494-a5243898ba65" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-694dc0b3-a81b-4c4c-b494-a5243898ba65" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd2814c-b210-4cbf-920b-668e50a1456b]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:14 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 Nov 05 17:56:14 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:14 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:14 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65 Nov 05 17:56:14 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:15 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-694dc0b3-a81b-4c4c-b494-a5243898ba65" returned: 0 in 0.230s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-694dc0b3-a81b-4c4c-b494-a5243898ba65" released by "delete_volume" :: held 0.630s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Created reservations ['2e9acf15-61b3-49f5-bde8-209199812272', '0534e020-8e41-4733-90ca-6dc5a95c3c28', 'f49f879a-7c43-430a-869c-999563535936', '48a2be58-c3d0-4a05-a198-40d87c63d2fd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:15 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:56:15 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:15 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:56:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Deleted volume successfully. Nov 05 17:56:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-24e482b3-954e-4b46-a03c-83de8c9b1318 tempest-ProjectReaderTests-518711231 None] Lock "cinder-694dc0b3-a81b-4c4c-b494-a5243898ba65-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (6bbc1da2-5c3a-4a7c-8e2e-354da466a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20324919-100b-4624-bf26-335ab24f8d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20324919-100b-4624-bf26-335ab24f8d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277051397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ce91e6-adfc-49c9-a7b0-cca0718980b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:16Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500cb12c-bc31-4b52-a8bb-0e6340dee699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500cb12c-bc31-4b52-a8bb-0e6340dee699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14919e10-ac34-4a2b-a1ca-ab0e71276b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14919e10-ac34-4a2b-a1ca-ab0e71276b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ce91e6-adfc-49c9-a7b0-cca0718980b5', 'volume_name': 'volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18381fea-759d-4310-ae08-4e93f58f8138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18381fea-759d-4310-ae08-4e93f58f8138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737a253-0531-4555-811a-727caa9d9028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Volume 56ce91e6-adfc-49c9-a7b0-cca0718980b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5', 'volume_size': 1} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277051397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ce91e6-adfc-49c9-a7b0-cca0718980b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:16Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Creating volume 56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:56:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:16 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 1073741824 Nov 05 17:56:16 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:16 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 1073741824" returned: 0 in 0.387s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:16 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 Nov 05 17:56:16 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:16 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5" returned: 0 in 0.230s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] <== create_volume: return (655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737a253-0531-4555-811a-727caa9d9028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c00b5ac-9c88-4430-9909-09de4bef9893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Volume volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 (56ce91e6-adfc-49c9-a7b0-cca0718980b5): created successfully Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c00b5ac-9c88-4430-9909-09de4bef9893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (6bbc1da2-5c3a-4a7c-8e2e-354da466a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7334b61a-9ec4-4a4e-a07a-a42fe02454a4 tempest-ProjectReaderTests-518711231 None] Created volume successfully. Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Creating offline snapshot ceb716a3-03e5-4da3-bb4c-111cd467ad4a of volume 56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f43e7-fc3e-4e7d-a1a3-c47c6c386d64]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:17 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 Nov 05 17:56:17 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:17 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:17 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a 1G Nov 05 17:56:17 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:17 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a 1G" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:17 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a Nov 05 17:56:17 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:18 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a is being set with open permissions: ugo+rw Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:18 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a Nov 05 17:56:18 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:18 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:18 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.info Nov 05 17:56:18 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:18 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.info" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.info is being set with open permissions: ugo+rw Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:18 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.info Nov 05 17:56:18 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:18 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.info" returned: 0 in 0.226s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.752s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-94158c6e-b0aa-41c3-8f23-d15af11ffd3d tempest-ProjectReaderTests-518711231 None] Create snapshot completed successfully Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-ceb716a3-03e5-4da3-bb4c-111cd467ad4a-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Lock "cinder-ceb716a3-03e5-4da3-bb4c-111cd467ad4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-56ce91e6-adfc-49c9-a7b0-cca0718980b5" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-56ce91e6-adfc-49c9-a7b0-cca0718980b5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-ceb716a3-03e5-4da3-bb4c-111cd467ad4a" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-ceb716a3-03e5-4da3-bb4c-111cd467ad4a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Deleting offline snapshot ceb716a3-03e5-4da3-bb4c-111cd467ad4a of volume 56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] snapshot_file for this snap is: volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4acc43-0373-47f6-9127-8c123e8c1e91]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:19 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a Nov 05 17:56:19 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:19 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a" returned: 0 in 0.343s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[516c8505-7efc-47bf-a97d-e9d83bd430d0]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:19 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 Nov 05 17:56:19 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:20 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5" returned: 0 in 0.337s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:20 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a Nov 05 17:56:20 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:20 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:20 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a Nov 05 17:56:20 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:20 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5.ceb716a3-03e5-4da3-bb4c-111cd467ad4a" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-ceb716a3-03e5-4da3-bb4c-111cd467ad4a" released by "_delete_snapshot" :: held 1.323s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-56ce91e6-adfc-49c9-a7b0-cca0718980b5" released by "delete_snapshot" :: held 1.344s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Created reservations ['7e9c61c4-6707-4961-b1e0-b0f7a5657e70', 'd4e571ad-b482-40d9-a952-2e9f02b97159', '94b86ec4-fc47-443e-a3ff-ba250b5d4561', 'b8606491-bd18-4335-bb69-6e0b2c23eefa'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Delete snapshot completed successfully. Nov 05 17:56:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c4a3df8c-3e09-4055-ad2a-d40f309eb275 tempest-ProjectReaderTests-518711231 None] Lock "cinder-ceb716a3-03e5-4da3-bb4c-111cd467ad4a-delete_snapshot" released by "delete_snapshot" :: held 1.465s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-56ce91e6-adfc-49c9-a7b0-cca0718980b5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-56ce91e6-adfc-49c9-a7b0-cca0718980b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-56ce91e6-adfc-49c9-a7b0-cca0718980b5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-56ce91e6-adfc-49c9-a7b0-cca0718980b5" acquired by "delete_volume" :: waited 0.012s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70454c3-8430-40ee-921b-abb20cbeeceb]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:21 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 Nov 05 17:56:21 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:21 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:21 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5 Nov 05 17:56:21 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:22 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-56ce91e6-adfc-49c9-a7b0-cca0718980b5" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-56ce91e6-adfc-49c9-a7b0-cca0718980b5" released by "delete_volume" :: held 0.645s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Created reservations ['4e1d6369-1323-4952-bd81-ebe6e7826ea3', '342dc4d6-ad7d-40e4-833b-8829bbadc4a2', 'd18774ae-8712-4b58-8113-d3be392e6c95', '3163d64b-0321-41e6-b979-e7864acb32af'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:22 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:56:22 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:22 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.228s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:56:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Deleted volume successfully. Nov 05 17:56:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b2b8e1b-c99a-4a35-afa8-63db60457ef9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-56ce91e6-adfc-49c9-a7b0-cca0718980b5-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (8f4a691d-e891-40de-bff3-e7ce46455fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3298a8-b3ce-4e93-9bc6-70f98f0b5e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3298a8-b3ce-4e93-9bc6-70f98f0b5e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874647872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c7a653-ba47-4b45-aaf0-ba81cf32c81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:23Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fb3344-466b-47d6-a2a7-90fbbe920b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fb3344-466b-47d6-a2a7-90fbbe920b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afea3089-0e5e-4485-a635-68bdd029b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afea3089-0e5e-4485-a635-68bdd029b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8c7a653-ba47-4b45-aaf0-ba81cf32c81d', 'volume_name': 'volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23af92c-9aa3-4f67-9b70-a182b336f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23af92c-9aa3-4f67-9b70-a182b336f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7e129-219c-4428-95b6-19debf6b0b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Volume f8c7a653-ba47-4b45-aaf0-ba81cf32c81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d', 'volume_size': 1} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874647872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c7a653-ba47-4b45-aaf0-ba81cf32c81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:23Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Creating volume f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:56:23 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:23 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d 1073741824 Nov 05 17:56:23 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:23 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d 1073741824" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:23 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d Nov 05 17:56:23 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:23 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7e129-219c-4428-95b6-19debf6b0b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4ac566-7228-4043-ba7e-f2f8c7bf9528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Volume volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d (f8c7a653-ba47-4b45-aaf0-ba81cf32c81d): created successfully Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4ac566-7228-4043-ba7e-f2f8c7bf9528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (8f4a691d-e891-40de-bff3-e7ce46455fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-defb3e0a-8294-4eec-b189-4405985068ea tempest-ProjectReaderTests-518711231 None] Created volume successfully. Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Creating offline snapshot d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b of volume f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e17d28-bb05-483d-9341-6a632b7c4722]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:24 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d Nov 05 17:56:24 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:24 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:24 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b 1G Nov 05 17:56:24 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:24 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b 1G" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:24 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b Nov 05 17:56:24 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:25 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:25 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b is being set with open permissions: ugo+rw Nov 05 17:56:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:25 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b Nov 05 17:56:25 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:25 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" returned: 0 in 0.232s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:25 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.info Nov 05 17:56:25 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:25 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.info" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:25 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.info is being set with open permissions: ugo+rw Nov 05 17:56:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:25 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.info Nov 05 17:56:25 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:25 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.info" returned: 0 in 0.232s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-349e7d85-8fa8-4576-bd43-fe41a57de2f4 tempest-ProjectReaderTests-518711231 None] Create snapshot completed successfully Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Lock "cinder-d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Deleting offline snapshot d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b of volume f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] snapshot_file for this snap is: volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c53fe-746a-4234-a6e9-a22716414075]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:26 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b Nov 05 17:56:26 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:26 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" returned: 0 in 0.343s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d273b4-aecb-43fb-8e0c-dee0827c0218]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:26 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d Nov 05 17:56:26 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:27 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:27 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b Nov 05 17:56:27 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:27 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:27 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b Nov 05 17:56:27 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:27 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d.d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b" released by "_delete_snapshot" :: held 1.327s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" released by "delete_snapshot" :: held 1.349s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Created reservations ['5d79f0be-c29d-4c93-b9aa-61d39b5e9bd7', '01fdba2d-8227-44a0-a01a-20c5ede9c879', 'aacb120b-c086-49a1-ab77-3fc4db30f07f', 'f06fb358-69b5-4b71-9fbe-c8819e07aee6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Delete snapshot completed successfully. Nov 05 17:56:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df9e3ead-e092-494e-a0db-dac85af21cf0 tempest-ProjectReaderTests-518711231 None] Lock "cinder-d6f4abcd-6821-4d93-ad6b-ee1c7ed0284b-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Lock "cinder-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e89c9-ed43-4c66-b575-5ac5ada3a9f3]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:28 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d Nov 05 17:56:28 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:28 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:28 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d Nov 05 17:56:28 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:29 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" returned: 0 in 0.227s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d" released by "delete_volume" :: held 0.619s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Created reservations ['a00ce483-e4a0-4d50-8e2f-8dfc4591c00e', 'c85179e1-0146-4c3b-8ef9-3c01540ac9e0', '5e73d56d-e871-4d56-b927-fc23c512d5d9', '7a1e806e-3a7a-4423-9b3f-00d2432b744e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:29 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:56:29 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:29 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:56:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Deleted volume successfully. Nov 05 17:56:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-62c1bf8f-c3de-4b1d-827f-8ecd6e5b6f30 tempest-ProjectReaderTests-518711231 None] Lock "cinder-f8c7a653-ba47-4b45-aaf0-ba81cf32c81d-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (7a661f40-1135-45ea-b97e-8cc23209c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4663d88a-a4df-4642-94c1-b2b5d7ab9635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4663d88a-a4df-4642-94c1-b2b5d7ab9635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346625647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c13dfb8-9518-43a6-a399-529ef4a931d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:30Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2112406-db29-4535-8da9-5863b7144c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2112406-db29-4535-8da9-5863b7144c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9efcfa9-73b1-47e4-9137-b0e4c032a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9efcfa9-73b1-47e4-9137-b0e4c032a347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c13dfb8-9518-43a6-a399-529ef4a931d9', 'volume_name': 'volume-6c13dfb8-9518-43a6-a399-529ef4a931d9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a460af23-9492-458b-88d7-4977dddc7a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a460af23-9492-458b-88d7-4977dddc7a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46652bda-0ca8-405c-b6a4-f9367fae3d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Volume 6c13dfb8-9518-43a6-a399-529ef4a931d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c13dfb8-9518-43a6-a399-529ef4a931d9', 'volume_size': 1} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T16:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346625647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c13dfb8-9518-43a6-a399-529ef4a931d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a502f95d84895bf4544b6cb4a735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T16:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T16:56:30Z,use_quota=True,user_id='a61c948f99fa442ba7374c40f1a56667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf),volume_type_id=cb6f5600-ae26-4a0f-b9a4-0b2ead3c07bf)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Creating volume 6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Selected osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 17:56:30 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] casted to osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8 Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:30 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 1073741824 Nov 05 17:56:30 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:30 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 1073741824" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:30 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 Nov 05 17:56:30 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:30 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46652bda-0ca8-405c-b6a4-f9367fae3d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c13dfb8-9518-43a6-a399-529ef4a931d9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8f3396-4271-4715-8c9b-de0b9d1cffe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 17:56:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Volume volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 (6c13dfb8-9518-43a6-a399-529ef4a931d9): created successfully Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8f3396-4271-4715-8c9b-de0b9d1cffe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 17:56:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Flow 'volume_create_manager' (7a661f40-1135-45ea-b97e-8cc23209c98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 17:56:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5898349e-b774-4184-ad41-79697b452541 tempest-ProjectReaderTests-518711231 None] Created volume successfully. Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Creating offline snapshot 3d804159-97c5-4fde-b0b8-e4765f15b6ca of volume 6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[27df6803-48eb-4d11-87b4-d9f05d1181ae]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:31 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 Nov 05 17:56:31 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:31 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:31 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca 1G Nov 05 17:56:31 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:31 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca 1G" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:31 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca Nov 05 17:56:31 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:32 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 -F qcow2 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:32 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca is being set with open permissions: ugo+rw Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:32 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca Nov 05 17:56:32 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:32 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:32 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.info Nov 05 17:56:32 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:32 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.info" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:32 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.info is being set with open permissions: ugo+rw Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:32 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.info Nov 05 17:56:32 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:32 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.info" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-20287814-29fd-4859-a121-f4dd4f86d603 tempest-ProjectReaderTests-518711231 None] Create snapshot completed successfully Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-3d804159-97c5-4fde-b0b8-e4765f15b6ca-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-3d804159-97c5-4fde-b0b8-e4765f15b6ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-6c13dfb8-9518-43a6-a399-529ef4a931d9" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-6c13dfb8-9518-43a6-a399-529ef4a931d9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-3d804159-97c5-4fde-b0b8-e4765f15b6ca" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-3d804159-97c5-4fde-b0b8-e4765f15b6ca" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Deleting offline snapshot 3d804159-97c5-4fde-b0b8-e4765f15b6ca of volume 6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] snapshot_file for this snap is: volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f32f4-e618-4c1e-a33d-bc95160ca073]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:33 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca Nov 05 17:56:33 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:33 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c13dfb8-9518-43a6-a399-529ef4a931d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a1b8c3-1968-4c4b-aae2-0a2a8daef1ab]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:33 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 Nov 05 17:56:33 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:34 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:34 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca Nov 05 17:56:34 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:34 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:34 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca Nov 05 17:56:34 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:34 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9.3d804159-97c5-4fde-b0b8-e4765f15b6ca" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-3d804159-97c5-4fde-b0b8-e4765f15b6ca" released by "_delete_snapshot" :: held 1.354s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-6c13dfb8-9518-43a6-a399-529ef4a931d9" released by "delete_snapshot" :: held 1.375s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Created reservations ['2186cbd8-56af-4049-b0d5-71c628b4eebb', '9bd42ee8-bb0b-4aa5-9f0b-54615828695c', 'b0c8b2d9-e771-48bd-804b-ecfcde6e35d7', '60479022-e5ec-4e9f-82d1-9a08316adc3a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Delete snapshot completed successfully. Nov 05 17:56:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe1fcf16-4200-4502-a463-49f0571dc0c9 tempest-ProjectReaderTests-518711231 None] Lock "cinder-3d804159-97c5-4fde-b0b8-e4765f15b6ca-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-6c13dfb8-9518-43a6-a399-529ef4a931d9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Lock "cinder-6c13dfb8-9518-43a6-a399-529ef4a931d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Acquiring lock "cinder-quobyte-6c13dfb8-9518-43a6-a399-529ef4a931d9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-6c13dfb8-9518-43a6-a399-529ef4a931d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2634b0-6216-4181-8042-80bb88860e87]: (4, 'qcow2') {{(pid=88298) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:35 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 Nov 05 17:56:35 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:35 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:35 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9 Nov 05 17:56:35 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:36 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e/volume-6c13dfb8-9518-43a6-a399-529ef4a931d9" returned: 0 in 0.253s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Lock "cinder-quobyte-6c13dfb8-9518-43a6-a399-529ef4a931d9" released by "delete_volume" :: held 0.677s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Created reservations ['129ec594-56e0-4ef9-9607-e87da950d1b5', 'e7a6427d-98dd-4c6b-ab31-b87da3b46de9', '8c207714-0bb6-4b85-a219-7b37d1e3bc42', '364a998c-a942-4530-a33f-d0a1c39d3d0c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:56:36 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:56:36 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:56:36 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:56:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Deleted volume successfully. Nov 05 17:56:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7992061c-6509-4c28-9fc1-9e5d2e046f79 tempest-ProjectReaderTests-518711231 None] Lock "cinder-6c13dfb8-9518-43a6-a399-529ef4a931d9-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 17:56:46 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=115,cinder:SELECT=91,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:56:46 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=80,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=10 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 17:57:13 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:57:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 17:57:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 17:57:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 17:57:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-78b99233-be69-4079-af62-ba3abeef49e8'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 17:57:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 17:57:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 17:57:13 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e Nov 05 17:57:13 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 17:57:14 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Nov 05 17:57:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198044036d2c3e2ce8de323883d2057e" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 17:57:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 17:57:14 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 17:57:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 17:57:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-051c0226-b5cf-4d49-bda3-079384751610 None None] thread info: [<_MainThread(MainThread, started 127147531169920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}